-- Logs begin at Tue 2022-09-13 13:32:06 UTC, end at Tue 2022-09-13 14:53:18 UTC. -- Sep 13 14:03:47.510507 dv-cinder-857434-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 14:03:47.518877 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 14:03:47 2022] *** Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: nodename: dv-cinder-857434-1-iscsi Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: machine: x86_64 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: clock source: unix Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: pcre jit disabled Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: detected number of CPU cores: 4 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: current working directory: / Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: detected binary path: /usr/bin/uwsgi-core Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: your processes number limit is 47680 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: your memory page size is 4096 bytes Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: detected max file descriptor number: 2048 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: lock engine: pthread robust mutexes Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: thunder lock: enabled Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 14:03:47.525778 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 14:03:47.561028 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: Python main interpreter initialized at 0x55bb555e39c0 Sep 13 14:03:47.561028 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: python threads support enabled Sep 13 14:03:47.561028 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: your server socket listen backlog is limited to 100 connections Sep 13 14:03:47.561028 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: your mercy for graceful operations on workers is 90 seconds Sep 13 14:03:47.561376 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 14:03:47.561459 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: *** Operational MODE: preforking *** Sep 13 14:03:47.561696 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: *** uWSGI is running in multiple interpreter mode *** Sep 13 14:03:47.561696 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: spawned uWSGI master process (pid: 105613) Sep 13 14:03:47.561885 dv-cinder-857434-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 14:03:47.562505 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: spawned uWSGI worker 1 (pid: 105614, cores: 1) Sep 13 14:03:47.564975 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: spawned uWSGI worker 2 (pid: 105615, cores: 1) Sep 13 14:03:47.564975 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 14:03:48.218975 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 14:03:48.219567 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 14:03:49.303258 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:03:49.303258 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: from cryptography.utils import int_from_bytes Sep 13 14:03:49.303883 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:03:49.303883 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: from cryptography.utils import int_from_bytes Sep 13 14:03:49.304036 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:03:49.304036 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: from cryptography.utils import int_from_bytes Sep 13 14:03:49.304036 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:03:49.304036 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: from cryptography.utils import int_from_bytes Sep 13 14:03:51.780796 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 14:03:51.781416 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 14:03:51.781516 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 14:03:51.781516 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 14:03:51.781991 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 14:03:51.782075 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 14:03:51.782170 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 14:03:51.782170 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 14:03:51.782325 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 14:03:51.782409 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 14:03:51.782488 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.782766 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.782866 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.783079 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.783212 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.783388 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.783492 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.783702 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.783798 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784004 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784093 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784318 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784414 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784630 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784721 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.784944 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785034 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785196 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785286 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785504 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785605 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785837 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.785927 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-1-iscsi {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.786154 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.786249 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-1-iscsi {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.786452 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.786551 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.786753 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.786842 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787056 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787143 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787348 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787459 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787656 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787750 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.787950 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.788038 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.788260 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.788441 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.788871 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.788983 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.789056 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.789169 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.789342 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.789437 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.790206 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.790397 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.790609 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.790796 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.791003 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.791185 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.791404 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.791586 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.791783 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.791962 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.792123 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.792346 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.792544 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.792740 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.792930 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-1-iscsi {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.793118 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.793423 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.793606 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-1-iscsi {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.793850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.794040 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.794241 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.794430 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.794619 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.794808 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795023 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795197 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795366 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795524 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795655 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795793 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.795950 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796079 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796204 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796342 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796469 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796633 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796768 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.796901 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797027 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797152 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797277 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797410 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797537 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797670 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.797828 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798003 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798147 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798283 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798419 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798544 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798676 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798803 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.798937 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799064 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799188 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799319 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799451 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799598 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799818 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.799950 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800075 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800253 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800390 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800530 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800711 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800711 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800971 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.800971 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.801213 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.801351 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.801483 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.801616 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.801770 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.801911 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802051 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802182 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802313 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802436 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802566 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802690 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802827 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.802964 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803095 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803220 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803349 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803473 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803605 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803741 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.803874 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804000 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804129 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804262 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804394 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804517 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804640 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804761 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.804884 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.805015 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.805139 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.805371 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806075 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806075 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806314 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806314 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806566 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806691 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806812 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.806937 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807060 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807193 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807325 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807449 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807572 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807701 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807835 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.807992 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.808121 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.808292 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.808426 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.808595 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.808730 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.808893 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809018 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809195 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809324 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809456 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809597 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809751 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.809896 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810026 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810152 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810328 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810471 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810628 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810758 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.810930 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811231 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811362 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811527 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811656 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811826 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.811954 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.812126 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.812256 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.812423 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.812558 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.812722 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.812852 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813023 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813160 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813324 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813453 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813619 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813797 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.813938 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814072 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814229 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814359 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814528 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814657 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814828 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.814956 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.815138 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.815252 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.815435 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.815552 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.815733 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.815822 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816031 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816118 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816331 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816425 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816634 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816724 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.816930 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.817022 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.817226 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.817312 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.817531 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.817617 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.817852 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818012 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818153 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818283 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818450 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818541 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818749 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.818835 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819046 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819141 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819355 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819443 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819649 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819742 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.819948 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820044 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820242 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820328 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820640 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820840 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.820969 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.821172 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.821358 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.821522 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.821717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.821841 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822038 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822127 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822338 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822427 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822637 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822747 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.822936 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823023 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823229 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823328 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823542 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823639 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823859 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.823949 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.824162 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.824254 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.824464 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.824561 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.824761 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.824849 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.825066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.825198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.825381 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:03:51.825479 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.825704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.825826 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.826057 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.826144 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.826364 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.826451 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.826689 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.826786 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827014 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827112 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827326 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827426 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827631 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827718 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.827937 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828023 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828247 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828335 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828550 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828635 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828855 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.828952 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.829159 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.829245 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.829467 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.829562 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.829802 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.829915 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.830121 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.830211 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.830430 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.830516 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.830740 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.830835 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831053 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831141 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831354 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831448 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831666 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831760 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.831981 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.832076 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.832294 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.832382 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.832602 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.832702 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.832909 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833002 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833250 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833346 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833612 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833767 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833892 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.833982 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.834205 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.834292 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.834511 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.834612 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.834814 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.834909 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.835117 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.835205 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.835424 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.835512 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.835744 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.835830 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.836049 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.836136 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.836355 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.836442 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.836699 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.836788 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837017 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837155 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837325 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837427 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837628 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837744 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.837957 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.838046 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.838262 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.838359 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.838565 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.838654 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.838890 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839056 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839200 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839288 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839515 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839611 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839822 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.839920 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.840128 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.840224 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.840434 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.840520 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.840736 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.840881 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841041 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841169 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841343 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841471 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841646 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841839 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.841980 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842107 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842254 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842391 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842553 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842695 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842849 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.842976 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.843147 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.843283 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.843461 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.843598 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.843810 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.843947 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844074 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844211 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844352 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844479 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844642 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844780 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.844945 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845083 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845247 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845369 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845544 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845675 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845867 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.845997 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.846168 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.846306 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.846464 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.846594 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.846764 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.846901 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847068 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847204 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847366 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847495 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847667 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847808 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.847966 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848102 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848266 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848395 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848567 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848706 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848869 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.848998 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.849174 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.849310 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.849479 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.849623 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.849801 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.849933 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.850109 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.850250 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.850415 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.850553 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.850718 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.850852 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851023 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851153 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851355 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851487 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851657 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851787 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.851972 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.852615 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.852822 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853020 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853169 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853306 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853433 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853568 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853830 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.853971 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854111 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854247 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854382 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854523 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854777 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.854924 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855055 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855233 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855373 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855540 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855670 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855845 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.855975 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.856148 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.856288 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.856448 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.856578 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.856749 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.856885 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857048 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857186 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857349 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857481 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857647 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857795 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.857967 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.858107 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.858267 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.858396 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.858589 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.858718 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.858893 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859033 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859229 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859367 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859541 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859671 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859859 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.859991 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.860164 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.860294 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.860472 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.860610 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.860775 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.860906 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.861081 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.861221 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.861382 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.861525 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.861686 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.861863 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862001 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862134 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862318 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862456 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862623 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862751 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.862924 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.863052 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.863232 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.863373 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.863535 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.863663 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.863844 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864050 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864177 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864317 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864443 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864574 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864745 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.864881 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.865070 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.865198 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.865383 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.865512 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.865699 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.865852 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866040 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866170 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866351 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866488 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866662 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866792 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.866968 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.867099 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.867276 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.867419 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.867584 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.867721 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.868535 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.868667 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.868951 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.869088 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.869215 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.869349 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.869485 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.869613 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.869860 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870004 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870143 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870280 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870413 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870547 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870673 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870799 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.870931 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871071 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871206 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871333 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871458 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871591 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871790 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.871936 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.872098 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.872237 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.872408 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.872546 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.872726 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.872866 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873030 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873158 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873335 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873465 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873634 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873788 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.873954 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874173 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874304 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874429 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874569 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874696 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874843 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.874979 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.875148 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.875279 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.875445 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.875576 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.875746 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.875881 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876047 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876175 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876345 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876476 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876644 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876774 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.876943 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.877080 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.877252 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.877383 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.877555 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.877696 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.877886 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878027 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878197 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878328 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878492 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878628 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878790 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.878929 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879091 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879219 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879396 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879536 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879696 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879835 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.879995 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.880132 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.880293 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.880429 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.880596 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.880727 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.880920 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881048 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881219 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881350 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881523 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881653 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881856 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.881985 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.882163 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.882305 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.882467 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.882597 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.882767 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.882963 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.883094 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.883225 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.883392 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.883520 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.883822 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.883953 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884072 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884225 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884430 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884559 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884685 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884812 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.884946 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885082 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885216 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885342 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885477 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885604 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885795 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.885942 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.886105 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.886235 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.886413 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.886543 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.886720 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.886859 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.887019 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.887147 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.887325 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.887456 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.887641 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.887892 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.888201 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.888339 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.888516 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.888651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.888829 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.888960 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.889142 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.889271 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.889461 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.889601 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.889807 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.889949 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.890132 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.890271 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.890438 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.890567 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.890736 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.890865 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891039 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891169 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891338 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891468 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891635 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891765 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.891969 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892099 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892225 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892358 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892513 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892641 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892812 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.892941 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.893112 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.893249 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.893411 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.893548 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.893707 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.893885 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894013 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894142 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894313 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894468 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894658 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894786 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.894911 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895036 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895193 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895333 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895491 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895621 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895790 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.895911 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896093 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896230 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896390 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896520 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896685 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896823 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.896982 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.897119 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.897283 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.897414 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.897599 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.897752 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.897934 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.898064 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.898260 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.898390 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.898581 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.898717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.898881 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.899065 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.899211 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.899338 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.899506 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.899737 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.899889 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900018 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900144 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900305 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900447 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900575 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900714 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900848 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.900976 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.901109 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.901242 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.901402 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.901540 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.901806 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.901968 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902107 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902234 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902368 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902503 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902638 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902765 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.902898 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903032 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903196 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903335 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903501 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903633 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903801 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.903932 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.904113 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.904244 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.904407 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.904810 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905005 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905142 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905277 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905411 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905538 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905672 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.905857 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906002 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906158 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906294 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906466 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906614 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906750 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.906886 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907043 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907174 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907340 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907478 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907639 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907777 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.907937 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908233 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908363 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908536 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908678 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908854 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.908997 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.909131 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.909258 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.909393 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.909521 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.909698 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.909850 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910016 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910146 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910314 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910454 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910615 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910745 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.910920 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911049 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911224 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911362 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911519 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911647 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911819 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.911959 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.912120 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.912258 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.912416 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.912546 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.912714 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.912855 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913012 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913142 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913307 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913437 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913602 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913779 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.913921 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.914049 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.914203 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.914334 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.914499 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.915208 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.915546 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.915692 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.915692 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.915968 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916094 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916223 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916349 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916475 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916726 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916861 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.916990 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.917116 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.917250 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.917499 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.917630 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.917825 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.917967 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.918137 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.918268 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.918450 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.918580 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.918754 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.918893 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919057 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919363 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919504 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919662 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919799 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.919968 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920098 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920269 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920473 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920612 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920740 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920867 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.920993 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.921140 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.921285 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.921450 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.921580 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.921774 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.921921 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.922075 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.922213 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.922384 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.922515 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.922694 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.922825 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923006 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923145 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923305 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923435 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923606 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923737 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.923908 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924039 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924208 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924347 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924510 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924642 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924812 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.924942 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.925112 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.925241 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.925415 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.925566 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.925796 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.925927 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926054 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926187 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926314 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926446 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926605 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926737 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.926908 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927039 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927207 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927345 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927503 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927633 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927805 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.927941 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.928104 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.928244 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.928399 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.928527 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.928703 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.928834 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929000 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929138 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929298 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929427 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929756 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.929989 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.930134 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.930356 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.931026 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.931292 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.931424 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.931605 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.931737 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.931913 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932044 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932214 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932348 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932521 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932651 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932827 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.932957 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.933137 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.933276 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.933444 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.933580 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.933789 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.933924 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.934175 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.934306 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.934477 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.934614 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.934777 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.934907 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935075 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935219 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935372 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935500 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935677 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935821 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.935972 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936114 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936268 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936397 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936565 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936694 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936861 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.936998 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.937160 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.937293 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.937470 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.937597 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.937786 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.937933 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.938106 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.938237 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.938474 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.938601 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.938810 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.938938 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.939111 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.939240 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.939464 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.939591 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.939780 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.939931 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.940094 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.940224 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.940409 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.940538 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.940705 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.940841 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941013 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941144 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941315 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941447 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941622 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941803 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.941943 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.942072 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.942254 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.942383 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.942563 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.942693 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.942868 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943000 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943176 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943312 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943478 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943617 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943784 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.943913 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.944100 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.944228 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.944410 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.944555 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.944728 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.944858 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.945091 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.945219 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.945406 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.945551 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.945739 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.945933 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.946090 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.946219 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.946412 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.946593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.946725 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.946916 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947047 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947219 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947358 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947519 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947657 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947838 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.947980 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.948140 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.948280 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.948446 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.948580 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.948750 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.948878 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949050 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949347 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949477 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949643 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949821 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.949962 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.950101 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.950267 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.950395 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.950565 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.950693 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.950878 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951007 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951185 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951314 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951498 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951626 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951797 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.951938 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.952101 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.952238 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.952406 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.952536 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.952706 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.952837 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953004 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953140 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953301 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953430 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953602 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953757 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.953949 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.954080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.954255 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.954397 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.954573 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.954711 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.954896 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955027 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955202 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955342 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955524 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955651 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955841 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.955975 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.956154 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.956293 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.956458 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.956596 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.956763 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.956891 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.957077 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.957216 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.957374 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.957501 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.957671 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.957824 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958002 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958133 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958297 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958426 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958594 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958724 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.958892 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959028 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959190 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959323 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959483 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959611 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959782 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.959918 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960066 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960204 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960364 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960494 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960666 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960796 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.960967 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.961095 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.961268 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.961408 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.961581 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.961711 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.961916 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.962085 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.962202 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.962386 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.962518 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.962723 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.962853 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963028 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963158 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963351 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963491 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963653 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963783 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.963968 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.964112 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.964277 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.964415 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.964585 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.964715 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.964895 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965034 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965206 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965337 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965517 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965647 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965846 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.965989 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.966145 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.966275 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.966450 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.966589 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.966760 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.966968 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.967097 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.967224 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.967372 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.967502 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.967890 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968030 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968218 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968348 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968528 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968660 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968839 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.968970 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.969141 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.969271 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.969449 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.969579 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.969774 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.969907 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970084 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970214 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970390 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970519 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970693 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970823 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.970994 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.971130 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.971314 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.971454 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.971630 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.971767 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.971946 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.972075 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.972275 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.972414 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.972584 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.972712 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.972893 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.973023 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.973201 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.973338 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.973505 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.973633 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.973875 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974010 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974226 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974355 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974482 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974609 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974768 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.974914 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975074 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975202 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975380 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975510 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975685 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975816 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.975990 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.976127 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.976295 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.976432 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.976600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.976734 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.976902 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.977035 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.977747 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.977893 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.978054 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.978185 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.978360 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.978492 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.978679 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.978810 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979005 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979138 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979318 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979454 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979625 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979764 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.979931 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.980071 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.980238 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.980368 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.980753 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.980883 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.981062 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.981193 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.981388 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.981517 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.981710 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.981907 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982037 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982166 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982346 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982476 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982658 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982800 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.982979 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.983100 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.983278 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.983406 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.983582 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.983721 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.983887 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984015 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984190 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984320 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984489 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984627 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984804 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.984932 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.985107 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.985242 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.985404 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.985534 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.985717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.985866 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.986042 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.986181 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.986568 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.986700 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.986907 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987038 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987216 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987344 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987531 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987661 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987849 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.987989 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.988158 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.988298 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.988458 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.988589 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.988773 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.988903 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.989074 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.989290 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.989473 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.989606 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.989801 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.989932 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.990112 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.990259 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.990415 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.990558 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.990718 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.990848 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991021 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991161 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991326 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991455 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991623 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991754 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.991927 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.992057 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.992225 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.992353 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.992547 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.992677 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.993414 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.993571 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.993721 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.993889 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994049 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994180 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994355 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994493 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994656 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994784 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.994953 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995082 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995253 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995382 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995550 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995679 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995854 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.995990 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.996153 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.996281 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.996455 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.996590 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.996754 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.996894 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.997061 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.997192 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.997408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.997539 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.997712 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.997884 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998036 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998165 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998353 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998483 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998653 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998791 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.998950 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999261 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999390 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999568 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999883 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:51.999992 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.000187 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.000285 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.000493 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.000582 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.000832 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.000919 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.001145 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.001296 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.001677 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.001849 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.002053 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.002198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.002358 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.002488 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.002689 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.002822 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003018 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003148 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003325 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003465 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003632 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003763 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.003936 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004067 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004259 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004468 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004599 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004726 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004852 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.004979 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.005156 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.005295 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.005459 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.005595 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.005783 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.005922 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006090 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006232 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006392 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006534 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006691 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006821 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.006995 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.007131 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.007295 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.007425 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.007596 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.007734 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.007897 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.008034 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.008199 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.008335 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.008557 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.008691 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.008877 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009040 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009214 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009345 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009527 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009860 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.009992 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.010170 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.010303 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.010478 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.010619 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.010782 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.010912 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011083 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011213 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011387 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011531 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011689 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011819 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.011997 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.012127 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.012317 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.012458 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.012624 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.012761 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.012921 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.013051 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.013591 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.013721 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.013931 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.014061 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.014248 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.014377 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.014568 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.014698 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.014872 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015001 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015190 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015332 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015529 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015694 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015824 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.015950 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.016107 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.016239 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.016412 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.016549 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.016734 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.016873 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.017068 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.017213 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.017388 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.017518 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.017706 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.017856 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018028 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018160 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018329 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018458 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018625 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018755 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.018930 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019062 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019241 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019371 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019545 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019673 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019844 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.019975 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.020140 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.020270 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.020443 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.020573 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.020741 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.020872 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021038 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021176 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021335 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021478 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021635 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021783 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.021956 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022094 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022254 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022394 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022552 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022688 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022845 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.022974 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.023142 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.023281 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.023437 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.023579 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.023733 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.023864 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024075 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024221 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024377 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024550 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024714 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024842 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.024978 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.025106 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.025234 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.025369 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.025527 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.025658 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.025872 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026014 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026199 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026323 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026507 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026638 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026823 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.026955 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.027128 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.027258 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.027442 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.027591 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.027727 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.027859 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028045 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028176 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028359 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028500 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028669 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028800 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.028972 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.029111 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.029298 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.029441 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.029885 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030017 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030193 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030324 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030500 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030639 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030848 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.030985 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.031112 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.031247 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.031384 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.031513 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.031700 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.031840 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032020 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032151 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032322 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032451 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032636 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032765 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.032945 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.033077 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.033281 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.033409 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.033565 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.033702 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.033876 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034019 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034201 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034332 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034508 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034637 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034809 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.034951 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.035111 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.035249 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.035416 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.035553 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.035717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.035860 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036024 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036161 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036326 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036457 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036630 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036769 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.036937 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.037066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.037243 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.037373 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.037569 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.037699 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.037914 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038055 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038219 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038348 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038536 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038666 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038854 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.038985 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.039191 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.039328 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.039497 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.040144 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.040353 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.040549 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.040683 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.040824 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.040976 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.041115 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.041286 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.041416 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.041589 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.041790 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:03:52.041922 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 14:03:52.042061 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 14:03:52.194654 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO dbcounter [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Registered counter for database nova_api Sep 13 14:03:52.195550 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO dbcounter [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Registered counter for database nova_api Sep 13 14:03:52.216576 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_db.sqlalchemy.engines [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.218233 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_db.sqlalchemy.engines [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.224526 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writer thread running {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.225320 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writer thread running {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.281584 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.context [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),98002c82-0fa6-4467-9ed3-a3065eaa8d97(cell1) {{(pid=105614) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 14:03:52.281827 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.context [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),98002c82-0fa6-4467-9ed3-a3065eaa8d97(cell1) {{(pid=105615) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 14:03:52.285412 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_concurrency.lockutils [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:03:52.285659 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:03:52.285912 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_concurrency.lockutils [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:03:52.286143 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:03:52.287491 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_concurrency.lockutils [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:03:52.287722 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:03:52.288209 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_concurrency.lockutils [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:03:52.288431 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:03:52.288650 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_concurrency.lockutils [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:03:52.288868 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:03:52.290797 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_concurrency.lockutils [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:03:52.291049 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:03:52.292770 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO dbcounter [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Registered counter for database nova_cell0 Sep 13 14:03:52.293023 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO dbcounter [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Registered counter for database nova_cell0 Sep 13 14:03:52.296892 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO dbcounter [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Registered counter for database nova_cell1 Sep 13 14:03:52.297021 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO dbcounter [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Registered counter for database nova_cell1 Sep 13 14:03:52.304422 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_db.sqlalchemy.engines [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.306470 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_db.sqlalchemy.engines [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.307884 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_db.sqlalchemy.engines [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.309637 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_db.sqlalchemy.engines [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.312152 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writer thread running {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.313985 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writer thread running {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.319367 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writer thread running {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.452873 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writer thread running {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.459754 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO dbcounter [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Registered counter for database nova_cell0 Sep 13 14:03:52.461268 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO dbcounter [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Registered counter for database nova_cell0 Sep 13 14:03:52.467273 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_db.sqlalchemy.engines [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.470821 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG oslo_db.sqlalchemy.engines [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:03:52.472129 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writer thread running {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.475609 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writer thread running {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:03:52.810696 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: WARNING keystonemiddleware.auth_token [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:03:52.811258 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: WARNING keystonemiddleware.auth_token [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:03:52.817923 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: WARNING keystonemiddleware.auth_token [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:03:52.818350 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: WARNING keystonemiddleware.auth_token [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:03:53.159308 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: WARNING keystonemiddleware.auth_token [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:03:53.163473 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: WARNING keystonemiddleware.auth_token [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:03:53.165244 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: WARNING keystonemiddleware.auth_token [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:03:53.169451 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: WARNING keystonemiddleware.auth_token [None req-c211417f-8d77-45de-aa2d-19617416c5e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:03:53.170636 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb555e39c0 pid: 105615 (default app) Sep 13 14:03:53.172679 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:03:53.173880 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Sep 13 14:03:53.174283 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Sep 13 14:03:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:03:53.174828 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb555e39c0 pid: 105614 (default app) Sep 13 14:05:15.104025 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:15.105630 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Sep 13 14:05:15.110110 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:15.118397 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_api:SELECT=3 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:15.119322 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_cell1:SELECT=3 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:15.120039 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_cell0:SELECT=3 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:15.122217 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:15.993114 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-25c8ae84-bdc0-4d34-86a0-ac1f164d6a15 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:16.026544 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-25c8ae84-bdc0-4d34-86a0-ac1f164d6a15 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913580 Sep 13 14:05:16.027360 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 13 14:05:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:05:18.736046 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:18.737882 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-ff83d3f3-dee3-4e64-aff9-5fc0fb3cd99f None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Sep 13 14:05:18.741790 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:19.228026 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-91a210f2-4d60-444f-8248-0b569366487f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:19.278448 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-91a210f2-4d60-444f-8248-0b569366487f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.532594 Sep 13 14:05:19.279006 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:19.294811 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_api:SELECT=3 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:19.296585 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_cell1:SELECT=3 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:19.298536 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_cell0:SELECT=3 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:19.299288 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:19.507755 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-d377ce6e-67d0-40a1-aa7a-ec87bfd3da74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:19.577962 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-d377ce6e-67d0-40a1-aa7a-ec87bfd3da74 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289486 Sep 13 14:05:19.578731 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 13 14:05:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:22.225214 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-91a210f2-4d60-444f-8248-0b569366487f admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:22.226852 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-91a210f2-4d60-444f-8248-0b569366487f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002437 Sep 13 14:05:22.227265 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:22.884658 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-538b8bf7-0906-48da-8a87-3136d1c1d5f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "ram": 512}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:22.930050 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-538b8bf7-0906-48da-8a87-3136d1c1d5f3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.696486 Sep 13 14:05:22.930898 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:22.944734 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-7743adeb-a7fc-47ee-9763-65747f82c4e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:22.985122 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-7743adeb-a7fc-47ee-9763-65747f82c4e5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044456 Sep 13 14:05:22.985793 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 13 14:05:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:25.603859 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-538b8bf7-0906-48da-8a87-3136d1c1d5f3 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:25.604871 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-538b8bf7-0906-48da-8a87-3136d1c1d5f3 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 13 14:05:25.605262 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:26.040722 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-61fb60b9-80e7-4fd5-bbbe-e3ae6ac42d61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:26.061285 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-61fb60b9-80e7-4fd5-bbbe-e3ae6ac42d61 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449844 Sep 13 14:05:26.061850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:26.074575 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-5689d8b4-605f-48bc-a07a-e9f83cabda0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:26.103518 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-5689d8b4-605f-48bc-a07a-e9f83cabda0e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032465 Sep 13 14:05:26.104104 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 13 14:05:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:28.783350 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-61fb60b9-80e7-4fd5-bbbe-e3ae6ac42d61 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:28.784373 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-61fb60b9-80e7-4fd5-bbbe-e3ae6ac42d61 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 13 14:05:28.784785 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:29.198618 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-388e1de8-5dee-47a0-bf07-a717ad18cb7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:29.218124 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-388e1de8-5dee-47a0-bf07-a717ad18cb7b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426276 Sep 13 14:05:29.221760 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:29.234878 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-117d173c-4d17-4733-9ae7-8526d6f64575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:29.266839 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-117d173c-4d17-4733-9ae7-8526d6f64575 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038944 Sep 13 14:05:29.280381 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 13 14:05:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:31.897440 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-388e1de8-5dee-47a0-bf07-a717ad18cb7b admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:31.899470 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-388e1de8-5dee-47a0-bf07-a717ad18cb7b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002456 Sep 13 14:05:31.900391 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:32.390417 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c0c53a44-edb2-4bd7-b469-66a39385b21c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "vcpus": 4, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:32.409910 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-c0c53a44-edb2-4bd7-b469-66a39385b21c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503660 Sep 13 14:05:32.410639 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:32.431342 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-63c0d911-f873-40c4-9fbb-449401a76f1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:32.469297 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-63c0d911-f873-40c4-9fbb-449401a76f1c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044883 Sep 13 14:05:32.470462 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Sep 13 14:05:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:35.666730 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c0c53a44-edb2-4bd7-b469-66a39385b21c admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:35.667794 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-c0c53a44-edb2-4bd7-b469-66a39385b21c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Sep 13 14:05:35.668188 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:36.150658 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-1cd548af-ef52-48c1-9402-c91df8629c1f admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:36.184538 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-1cd548af-ef52-48c1-9402-c91df8629c1f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.509294 Sep 13 14:05:36.185301 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 13 14:05:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:05:38.999480 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c0c53a44-edb2-4bd7-b469-66a39385b21c admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:39.000537 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-c0c53a44-edb2-4bd7-b469-66a39385b21c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 13 14:05:39.000946 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:39.401166 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-1b17ec66-b8af-4bac-b15e-611c092c78c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:39.422822 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-1b17ec66-b8af-4bac-b15e-611c092c78c1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.414422 Sep 13 14:05:39.423371 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:39 2022] POST /compute/v2.1/flavors => generated 402 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:05:39.435634 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c27c887d-b1eb-4f62-88f9-cc5d2950afcb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:39.464288 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-c27c887d-b1eb-4f62-88f9-cc5d2950afcb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032410 Sep 13 14:05:39.464870 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 13 14:05:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:05:42.062367 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-1b17ec66-b8af-4bac-b15e-611c092c78c1 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:42.063376 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-1b17ec66-b8af-4bac-b15e-611c092c78c1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 13 14:05:42.063774 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:42.450657 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-15a8c9d9-9901-401b-ac53-b31f98377d9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "id": "2", "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:42.473487 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-15a8c9d9-9901-401b-ac53-b31f98377d9f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402960 Sep 13 14:05:42.474014 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:42.486137 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-836535b6-7171-4bf7-9409-6692c867aa32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:42.512713 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-836535b6-7171-4bf7-9409-6692c867aa32 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030231 Sep 13 14:05:42.513689 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 13 14:05:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:45.188709 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-15a8c9d9-9901-401b-ac53-b31f98377d9f admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:45.189722 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-15a8c9d9-9901-401b-ac53-b31f98377d9f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 13 14:05:45.190172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:05:45.628399 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-50801cf5-66f6-4ca9-8ac6-a0ad5689a4fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "name": "m1.medium", "id": "3", "disk": 40}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:45.652537 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-50801cf5-66f6-4ca9-8ac6-a0ad5689a4fa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.456202 Sep 13 14:05:45.653158 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:45.666179 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-7f1c4e24-e874-467b-a3d9-abf7c8e9e037 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:45.670899 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:45.698572 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-7f1c4e24-e874-467b-a3d9-abf7c8e9e037 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036048 Sep 13 14:05:45.699509 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 13 14:05:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:48.352198 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-50801cf5-66f6-4ca9-8ac6-a0ad5689a4fa admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:48.354119 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-50801cf5-66f6-4ca9-8ac6-a0ad5689a4fa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Sep 13 14:05:48.354726 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:05:48.797960 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a2232e2a-47c8-499f-9654-b4770351218a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "disk": 80, "id": "4", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:48.818921 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a2232e2a-47c8-499f-9654-b4770351218a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458025 Sep 13 14:05:48.820167 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:05:48.831812 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-9c80876a-02ab-4a6d-bd1f-45359545a375 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:48.859566 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-9c80876a-02ab-4a6d-bd1f-45359545a375 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031435 Sep 13 14:05:48.860148 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 13 14:05:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:05:51.540358 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a2232e2a-47c8-499f-9654-b4770351218a admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:05:51.541977 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a2232e2a-47c8-499f-9654-b4770351218a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Sep 13 14:05:51.542615 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:05:51.993893 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-bcc243ed-0786-4c17-9287-170a75e0b950 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "vcpus": 8}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:52.006392 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:05:52.019446 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-bcc243ed-0786-4c17-9287-170a75e0b950 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470506 Sep 13 14:05:52.020910 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Sep 13 14:05:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:05:52.033203 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-8250680f-1ec0-4a29-a53f-e7d16d2970db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:05:52.062461 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-8250680f-1ec0-4a29-a53f-e7d16d2970db admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033369 Sep 13 14:05:52.063906 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Sep 13 14:05:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:06:08.495267 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-bcc243ed-0786-4c17-9287-170a75e0b950 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:08.496307 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-bcc243ed-0786-4c17-9287-170a75e0b950 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 13 14:06:08.496704 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:06:08.508003 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:06:08.894037 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c95ae043-5423-41dc-96d5-33fcbc19b28e admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:08.913266 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-c95ae043-5423-41dc-96d5-33fcbc19b28e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410399 Sep 13 14:06:08.913824 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 13 14:06:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:06:10.210489 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-bcc243ed-0786-4c17-9287-170a75e0b950 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:10.211580 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-bcc243ed-0786-4c17-9287-170a75e0b950 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Sep 13 14:06:10.212007 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:10.731467 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-86751316-f6fe-45d0-a39a-66dc54eef56d admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:10.736778 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.wsgi [None req-86751316-f6fe-45d0-a39a-66dc54eef56d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-86751316-f6fe-45d0-a39a-66dc54eef56d admin admin] Request method failure captured: Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Accept: application/json Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Accept-Encoding: gzip, deflate Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Connection: keep-alive Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Content-Length: 0 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Host: 10.222.0.20 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Openstack-Api-Version: compute 2.92 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Openstack-System-Scope: None Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: User-Agent: python-novaclient Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Auth-Token: gAAAAABjII5Swfef_0wht9WT-nMAh8-gjcuvNRyIcjaoKxEeSKHXSpxwP0S44h0NveZ8cmVFrONXnfhzBT4Wg9mlsWxPZ9cD4VBbXyoXmO4Qckphi91qhrxZ68t5V65ZjOr3DKmDfRhIbDQp9FMO-77hBCyEobSBOLQig8t7VO1po9bhDOpYzV0 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Domain-Id: None Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Domain-Name: None Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Identity-Status: Confirmed Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Is-Admin-Project: True Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Domain-Id: default Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Domain-Name: Default Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Name: admin Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Role: member,reader,admin Sep 13 14:06:10.740593 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Roles: member,reader,admin Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}] Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant: admin Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant-Name: admin Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User: admin Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Domain-Id: default Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Domain-Name: Default Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Id: 9242a7b2cdf946a38262cb2b38f5cb44 Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Name: admin Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: method: > Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: exception: Flavor 42 could not be found. Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: action_args: {'id': '42'} Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:06:10.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:10.743172 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.744408 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-86751316-f6fe-45d0-a39a-66dc54eef56d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:06:10.745691 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-86751316-f6fe-45d0-a39a-66dc54eef56d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.395778 Sep 13 14:06:10.745691 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 13 14:06:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:10.751803 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-a3696f32-bcd5-44b7-87f4-ae5e1ed804db admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:10.775379 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-a3696f32-bcd5-44b7-87f4-ae5e1ed804db admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027023 Sep 13 14:06:10.775927 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 13 14:06:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:06:10.787133 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-3d14cc14-566a-43bf-9d20-ccf1914d2347 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:10.809255 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-3d14cc14-566a-43bf-9d20-ccf1914d2347 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026925 Sep 13 14:06:10.809810 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 13 14:06:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:06:10.819635 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-1043c9a1-ffb7-4efa-a447-ac4386ca70de admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:10.824803 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.wsgi [None req-1043c9a1-ffb7-4efa-a447-ac4386ca70de admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-1043c9a1-ffb7-4efa-a447-ac4386ca70de admin admin] Request method failure captured: Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Accept: application/json Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Accept-Encoding: gzip, deflate Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Connection: keep-alive Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Content-Length: 0 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Host: 10.222.0.20 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Openstack-Api-Version: compute 2.92 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Openstack-System-Scope: None Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: User-Agent: python-novaclient Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Auth-Token: gAAAAABjII5Swfef_0wht9WT-nMAh8-gjcuvNRyIcjaoKxEeSKHXSpxwP0S44h0NveZ8cmVFrONXnfhzBT4Wg9mlsWxPZ9cD4VBbXyoXmO4Qckphi91qhrxZ68t5V65ZjOr3DKmDfRhIbDQp9FMO-77hBCyEobSBOLQig8t7VO1po9bhDOpYzV0 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Domain-Id: None Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Domain-Name: None Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Identity-Status: Confirmed Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Is-Admin-Project: True Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Domain-Id: default Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Domain-Name: Default Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Name: admin Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Role: member,reader,admin Sep 13 14:06:10.828066 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Roles: member,reader,admin Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}] Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant: admin Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant-Name: admin Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User: admin Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Domain-Id: default Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Domain-Name: Default Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Id: 9242a7b2cdf946a38262cb2b38f5cb44 Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Name: admin Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: method: > Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: exception: Flavor 42 could not be found. Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: action_args: {'id': '42'} Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:06:10.829637 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:10.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:10.831961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-1043c9a1-ffb7-4efa-a447-ac4386ca70de admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:06:10.833197 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-1043c9a1-ffb7-4efa-a447-ac4386ca70de admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014116 Sep 13 14:06:10.833197 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 13 14:06:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 14:06:12.048623 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-3d14cc14-566a-43bf-9d20-ccf1914d2347 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:12.049694 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-3d14cc14-566a-43bf-9d20-ccf1914d2347 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 13 14:06:12.050111 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:12.579779 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-2a6a2206-2747-445d-a03e-5d8ae3d5a566 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:12.585509 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.wsgi [None req-2a6a2206-2747-445d-a03e-5d8ae3d5a566 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-2a6a2206-2747-445d-a03e-5d8ae3d5a566 admin admin] Request method failure captured: Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Accept: application/json Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Accept-Encoding: gzip, deflate Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Connection: keep-alive Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Content-Length: 0 Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Host: 10.222.0.20 Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Openstack-Api-Version: compute 2.92 Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Openstack-System-Scope: None Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: User-Agent: python-novaclient Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Auth-Token: gAAAAABjII5TPn7fEoDM8IUwG595tHreyXxy2WtpBbnj_2gHrjEqxyYXsy2M8GGXNBjk53LO-k_dqsoDbFUfKkvWS7Bu7bPFcsGzGej6X4pw25WmExsnm4AEJdsmNaYDWMq8Hnu_m9k-o6ftTI1NHUO3JFLR-fOVVjSkQ0CDMxovvzcRB4bUphU Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Domain-Id: None Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Domain-Name: None Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Identity-Status: Confirmed Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Is-Admin-Project: True Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Domain-Id: default Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Domain-Name: Default Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Name: admin Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Role: member,reader,admin Sep 13 14:06:12.587080 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Roles: member,reader,admin Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}] Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant: admin Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant-Name: admin Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User: admin Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Domain-Id: default Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Domain-Name: Default Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Id: 9242a7b2cdf946a38262cb2b38f5cb44 Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Name: admin Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: method: > Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: exception: Flavor 84 could not be found. Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: action_args: {'id': '84'} Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:06:12.588668 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:12.589748 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.591302 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-2a6a2206-2747-445d-a03e-5d8ae3d5a566 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:06:12.592667 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-2a6a2206-2747-445d-a03e-5d8ae3d5a566 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.398713 Sep 13 14:06:12.592667 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 13 14:06:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:12.598418 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-34de8adc-d94f-4e3b-b999-a4d2c0652a92 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:12.612966 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-34de8adc-d94f-4e3b-b999-a4d2c0652a92 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018193 Sep 13 14:06:12.613478 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 13 14:06:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:06:12.622841 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-804e6558-4064-4d24-a254-39f60f2143a8 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:12.639010 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-804e6558-4064-4d24-a254-39f60f2143a8 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019623 Sep 13 14:06:12.639539 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 13 14:06:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:06:12.649330 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-98cebfcd-aa22-454d-8128-63e1c4cd1f36 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:12.654505 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.wsgi [None req-98cebfcd-aa22-454d-8128-63e1c4cd1f36 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-98cebfcd-aa22-454d-8128-63e1c4cd1f36 admin admin] Request method failure captured: Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Accept: application/json Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Accept-Encoding: gzip, deflate Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Connection: keep-alive Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Content-Length: 0 Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Host: 10.222.0.20 Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Openstack-Api-Version: compute 2.92 Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Openstack-System-Scope: None Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: User-Agent: python-novaclient Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Auth-Token: gAAAAABjII5TPn7fEoDM8IUwG595tHreyXxy2WtpBbnj_2gHrjEqxyYXsy2M8GGXNBjk53LO-k_dqsoDbFUfKkvWS7Bu7bPFcsGzGej6X4pw25WmExsnm4AEJdsmNaYDWMq8Hnu_m9k-o6ftTI1NHUO3JFLR-fOVVjSkQ0CDMxovvzcRB4bUphU Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Domain-Id: None Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Domain-Name: None Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Identity-Status: Confirmed Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Is-Admin-Project: True Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Domain-Id: default Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Domain-Name: Default Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Name: admin Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Role: member,reader,admin Sep 13 14:06:12.655981 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Roles: member,reader,admin Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}] Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant: admin Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant-Name: admin Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User: admin Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Domain-Id: default Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Domain-Name: Default Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Id: 9242a7b2cdf946a38262cb2b38f5cb44 Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Name: admin Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: method: > Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: exception: Flavor 84 could not be found. Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: action_args: {'id': '84'} Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:06:12.657673 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:12.658717 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:12.659850 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-98cebfcd-aa22-454d-8128-63e1c4cd1f36 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:06:12.660906 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-98cebfcd-aa22-454d-8128-63e1c4cd1f36 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011475 Sep 13 14:06:12.660906 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Sep 13 14:06:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:13.909176 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-804e6558-4064-4d24-a254-39f60f2143a8 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:13.911046 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-804e6558-4064-4d24-a254-39f60f2143a8 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Sep 13 14:06:13.911446 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:14.434886 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c52be7f0-4070-457b-b809-ede84eeb28f1 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:14.440553 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.wsgi [None req-c52be7f0-4070-457b-b809-ede84eeb28f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c52be7f0-4070-457b-b809-ede84eeb28f1 admin admin] Request method failure captured: Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Accept: application/json Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Accept-Encoding: gzip, deflate Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Connection: keep-alive Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Content-Length: 0 Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Host: 10.222.0.20 Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Openstack-Api-Version: compute 2.92 Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Openstack-System-Scope: None Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: User-Agent: python-novaclient Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Auth-Token: gAAAAABjII5VEbT16Cxp2DHB54unLycsctL6fZvnB8K4KqMPBksUE9W00hWzFWrNWt9Q9PSZE3BQMcuryr4WLlfVRuXt0gvcEfUafeeUbU9d0Jg-EercEzzWKv3vLFGhfo0aHa1tro2qfKA-V7DepqK6yQWKE0siTnpeUj9v6AsDypiYuWYpUwY Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Domain-Id: None Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Domain-Name: None Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Identity-Status: Confirmed Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Is-Admin-Project: True Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Domain-Id: default Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Domain-Name: Default Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Project-Name: admin Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Role: member,reader,admin Sep 13 14:06:14.443198 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Roles: member,reader,admin Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}] Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant: admin Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-Tenant-Name: admin Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User: admin Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Domain-Id: default Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Domain-Name: Default Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Id: 9242a7b2cdf946a38262cb2b38f5cb44 Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: X-User-Name: admin Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: method: > Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: exception: Flavor 451 could not be found. Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: action_args: {'id': '451'} Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:06:14.444704 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:14.445600 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.447009 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-c52be7f0-4070-457b-b809-ede84eeb28f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:06:14.448293 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-c52be7f0-4070-457b-b809-ede84eeb28f1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395489 Sep 13 14:06:14.448293 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 13 14:06:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 14:06:14.454210 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-0ecbeab8-0016-4d71-8e15-2f475275252b admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:14.468995 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-0ecbeab8-0016-4d71-8e15-2f475275252b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018329 Sep 13 14:06:14.469508 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 13 14:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:06:14.478807 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:14.493864 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018507 Sep 13 14:06:14.494384 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Sep 13 14:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:06:14.504161 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-7f2b1813-4732-4db2-97d0-717d6f1ad676 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:14.509116 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.wsgi [None req-7f2b1813-4732-4db2-97d0-717d6f1ad676 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-7f2b1813-4732-4db2-97d0-717d6f1ad676 admin admin] Request method failure captured: Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Accept: application/json Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Accept-Encoding: gzip, deflate Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Connection: keep-alive Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Content-Length: 0 Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Host: 10.222.0.20 Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Openstack-Api-Version: compute 2.92 Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Openstack-System-Scope: None Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: User-Agent: python-novaclient Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Auth-Token: gAAAAABjII5VEbT16Cxp2DHB54unLycsctL6fZvnB8K4KqMPBksUE9W00hWzFWrNWt9Q9PSZE3BQMcuryr4WLlfVRuXt0gvcEfUafeeUbU9d0Jg-EercEzzWKv3vLFGhfo0aHa1tro2qfKA-V7DepqK6yQWKE0siTnpeUj9v6AsDypiYuWYpUwY Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Domain-Id: None Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Domain-Name: None Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Identity-Status: Confirmed Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Is-Admin-Project: True Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Domain-Id: default Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Domain-Name: Default Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Project-Name: admin Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Role: member,reader,admin Sep 13 14:06:14.510651 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Roles: member,reader,admin Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4d23d643906b4c84bfbe35da532a7c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4d23d643906b4c84bfbe35da532a7c31"}]}] Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant: admin Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant-Id: 4d23d643906b4c84bfbe35da532a7c31 Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-Tenant-Name: admin Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User: admin Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Domain-Id: default Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Domain-Name: Default Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Id: 9242a7b2cdf946a38262cb2b38f5cb44 Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: X-User-Name: admin Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: method: > Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: exception: Flavor 451 could not be found. Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: action_args: {'id': '451'} Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:06:14.512217 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:14.513188 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: ERROR nova.api.openstack.wsgi Sep 13 14:06:14.514543 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-7f2b1813-4732-4db2-97d0-717d6f1ad676 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:06:14.515793 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-7f2b1813-4732-4db2-97d0-717d6f1ad676 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011995 Sep 13 14:06:14.515793 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 13 14:06:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 14:06:15.736792 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:15.738721 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 13 14:06:15.739116 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:16.263544 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-ed62a60b-4380-4d91-8cb7-ea24d1974cb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:06:16.283785 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-ed62a60b-4380-4d91-8cb7-ea24d1974cb0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408387 Sep 13 14:06:16.284328 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 13 14:06:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:06:17.506841 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:17.507867 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 13 14:06:17.508259 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:18.025337 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-89fbc563-bb21-426c-8812-a45c51fddb26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:06:18.043582 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-89fbc563-bb21-426c-8812-a45c51fddb26 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400026 Sep 13 14:06:18.044122 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 13 14:06:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:06:19.279484 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:19.280487 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Sep 13 14:06:19.280876 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:19.801971 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-539580be-6311-4896-b996-b0328766ad27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:06:19.821214 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-539580be-6311-4896-b996-b0328766ad27 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.403052 Sep 13 14:06:19.821763 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 13 14:06:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:06:21.051188 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:21.052205 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Sep 13 14:06:21.052942 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:21.619414 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-d1252b58-0ae9-4d19-8bb2-600e1ca3a7f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:06:21.638362 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-d1252b58-0ae9-4d19-8bb2-600e1ca3a7f5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.438052 Sep 13 14:06:21.638914 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Sep 13 14:06:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:06:22.863767 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:22.864782 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 13 14:06:22.865209 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:06:23.389918 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-47635672-5500-4d34-a7b8-a808e5bfd837 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:06:23.410183 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-47635672-5500-4d34-a7b8-a808e5bfd837 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404480 Sep 13 14:06:23.410661 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Sep 13 14:06:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:07:20.051876 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:07:20.052888 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-a753ad24-30aa-496a-991c-dcc0627e9c04 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Sep 13 14:07:20.053315 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Tue Sep 13 14:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:07:20.063832 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:20.445882 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-0fdc7326-a674-4eaf-ba69-2e2b8ef9fa5c admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:07:20.466502 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-0fdc7326-a674-4eaf-ba69-2e2b8ef9fa5c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407137 Sep 13 14:07:20.467044 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Sep 13 14:07:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:07:20.488601 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_api:SELECT=14 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:07:20.492450 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-77c93c5b-34db-4d8a-9f2a-4de5c1c7bea7 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:07:20.499966 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-77c93c5b-34db-4d8a-9f2a-4de5c1c7bea7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012434 Sep 13 14:07:20.500489 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Sep 13 14:07:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:07:20.511787 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-808a2365-52c3-4f43-879a-8144a859a102 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:07:20.519717 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-808a2365-52c3-4f43-879a-8144a859a102 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011473 Sep 13 14:07:20.520228 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Sep 13 14:07:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:07:20.532630 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:07:20.539942 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011668 Sep 13 14:07:20.540457 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Sep 13 14:07:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:07:20.552046 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-e4bcc865-d03d-4cf3-b6d1-aaa98e6c20da admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:07:20.559321 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-e4bcc865-d03d-4cf3-b6d1-aaa98e6c20da admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010810 Sep 13 14:07:20.559841 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Sep 13 14:07:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:10:12.900713 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:12.901770 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Sep 13 14:10:12.902164 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:10:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:10:13.040839 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_api:SELECT=6 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:13.202059 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:13.206815 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:13.207289 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:13.207719 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:13.208424 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:13.208871 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:13.209287 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:13.240201 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-f040f0fd-0aee-4fdb-a3f6-3c70a43e89af admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200507 Sep 13 14:10:13.240753 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 13 14:10:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:10:14.342106 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:14.343124 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 13 14:10:14.343522 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:10:14.536746 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:14.540167 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:14.540653 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:14.541089 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:14.541824 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:14.542266 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:14.542674 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:14.562210 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-2a12b365-ac60-4b99-b2b1-a09ab99f2b90 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078169 Sep 13 14:10:14.562771 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 13 14:10:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:10:26.042402 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:26.043399 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 13 14:10:26.043786 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:10:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:10:26.186598 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_cell0:SELECT=4 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:26.187343 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_cell1:SELECT=4 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:26.187961 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG dbcounter [-] [105615] Writing DB stats nova_api:SELECT=8 {{(pid=105615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:10:26.239703 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:26.243117 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:26.243614 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:26.244068 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:26.245905 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:26.246738 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:26.247407 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:26.275790 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-4a4acef7-59da-4cdf-8ad4-391a1d541dfd admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.094148 Sep 13 14:10:26.276547 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 13 14:10:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:10:27.401384 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG nova.api.openstack.wsgi [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] Calling method '>' {{(pid=105614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:27.402438 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: INFO nova.api.openstack.requestlog [None req-d1f7044a-f0f3-4387-bb4f-830c37078ab1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Sep 13 14:10:27.402834 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: [pid: 105614|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Sep 13 14:10:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:10:27.594482 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG nova.api.openstack.wsgi [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Calling method '>' {{(pid=105615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:10:27.597929 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:27.598405 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:27.598865 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:27.599589 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:10:27.600044 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:10:27.600460 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: DEBUG oslo_concurrency.lockutils [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:10:27.622404 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: INFO nova.api.openstack.requestlog [None req-bef1ed8d-865a-4bce-bc13-c9ee071fe4fc admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079216 Sep 13 14:10:27.622944 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: [pid: 105615|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Sep 13 14:10:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:11:25.837666 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: Tue Sep 13 14:11:25 2022 - graceful shutdown triggered... Sep 13 14:11:25.835862 dv-cinder-857434-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 14:11:25.838692 dv-cinder-857434-1-iscsi devstack@n-api.service[105615]: Gracefully killing worker 2 (pid: 105615)... Sep 13 14:11:25.839076 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: Gracefully killing worker 1 (pid: 105614)... Sep 13 14:11:25.961977 dv-cinder-857434-1-iscsi devstack@n-api.service[105614]: DEBUG dbcounter [-] [105614] Writing DB stats nova_api:SELECT=4 {{(pid=105614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:11:26.836938 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: worker 1 buried after 1 seconds Sep 13 14:11:26.836938 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: worker 2 buried after 1 seconds Sep 13 14:11:26.836938 dv-cinder-857434-1-iscsi devstack@n-api.service[105613]: goodbye to uWSGI. Sep 13 14:11:26.838516 dv-cinder-857434-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 14:11:26.839064 dv-cinder-857434-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 14:11:26.841918 dv-cinder-857434-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 14:11:26.853348 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 14:11:26 2022] *** Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: nodename: dv-cinder-857434-1-iscsi Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: machine: x86_64 Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: clock source: unix Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: pcre jit disabled Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: detected number of CPU cores: 4 Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: current working directory: / Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: detected binary path: /usr/bin/uwsgi-core Sep 13 14:11:26.855402 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: your processes number limit is 47680 Sep 13 14:11:26.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: your memory page size is 4096 bytes Sep 13 14:11:26.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: detected max file descriptor number: 2048 Sep 13 14:11:26.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: lock engine: pthread robust mutexes Sep 13 14:11:26.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: thunder lock: enabled Sep 13 14:11:26.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 14:11:26.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 14:11:26.896428 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: Python main interpreter initialized at 0x55f33d06e9c0 Sep 13 14:11:26.896428 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: python threads support enabled Sep 13 14:11:26.896428 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: your server socket listen backlog is limited to 100 connections Sep 13 14:11:26.896428 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: your mercy for graceful operations on workers is 90 seconds Sep 13 14:11:26.896428 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 14:11:26.896428 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: *** Operational MODE: preforking *** Sep 13 14:11:26.896993 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: *** uWSGI is running in multiple interpreter mode *** Sep 13 14:11:26.896993 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: spawned uWSGI master process (pid: 120624) Sep 13 14:11:26.896779 dv-cinder-857434-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 14:11:26.901034 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: spawned uWSGI worker 1 (pid: 120642, cores: 1) Sep 13 14:11:26.902557 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: spawned uWSGI worker 2 (pid: 120643, cores: 1) Sep 13 14:11:26.902557 dv-cinder-857434-1-iscsi devstack@n-api.service[120624]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 14:11:27.588916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 14:11:27.654916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 14:11:28.783551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:11:28.783551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 13 14:11:28.784124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:11:28.784124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: from cryptography.utils import int_from_bytes Sep 13 14:11:28.823593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:11:28.823593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: from cryptography.utils import int_from_bytes Sep 13 14:11:28.824174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 14:11:28.824174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: from cryptography.utils import int_from_bytes Sep 13 14:11:31.178423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 14:11:31.179147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 14:11:31.179268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 14:11:31.179599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 14:11:31.180443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 14:11:31.180904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.181238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.181568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.181940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.182280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.182597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.182933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.183257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.183591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.183857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.184178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.184509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-1-iscsi {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.184837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.185148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.185462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.185811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.186125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.186455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.186765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.187275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.187728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.188041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.188365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.188706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.189029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.189342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.189664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.189996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.190347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.190649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.191098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-1-iscsi {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.191439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.191779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.192098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.198691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.199696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.200430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.201506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.201506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.201506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.201857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.202323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.202323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.202606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.202925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.203263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.203545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.203893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.204258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.204568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.204907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.205230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.205647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.205952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.206282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.206690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.206995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.207308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.207632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.207958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.208273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.208588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.208903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.209228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.209571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.209917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.210176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.210491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.210802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.211313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.211763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.212077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.212387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.212694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.213008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.213321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.213632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.213970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.214285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.214593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.214907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.215218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.215528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.215836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.216160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.216271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 14:11:31.216681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.216767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 14:11:31.216852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.216993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 14:11:31.217106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.217353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 14:11:31.217460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.217614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 14:11:31.217714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.218940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.219979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.220182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.220273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.220497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.220597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.220755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.220856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.221069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.221168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.221412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.221514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857434-1-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.221764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.221876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.222069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.222164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.222382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.222483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.223862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.224396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.224536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.224536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.224718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.224815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.224900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.225991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.226103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.226291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.226391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.226638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.226744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.226960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.227076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.227273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.227440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.227710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857434-1-iscsi {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.227797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.228033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.228116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.228347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.228435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.228697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.228796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.229059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.229156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.229376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.229460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.229702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.229824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.230041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.230123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.230362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.230441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.230669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.230763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.230987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.231067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.231303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.231382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.231623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.231713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.232959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.233175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.233175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.233353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.233440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.233530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.233616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.233706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.234915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.235221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.235313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.235398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.235496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.235581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.235665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.235665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.235845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.235926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.236024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.236118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.236202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.236287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.236379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.236464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.236557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.236643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.237037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.237140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.237227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.237341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.237429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.237521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.237616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.237702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.237702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.237901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.237988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.238073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.238165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.238256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.238342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.238439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.238525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.238609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.238699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.238783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.238925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.239026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.239242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.239335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.239566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.239699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.239875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.239980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.240192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.240285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.240549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.240639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.240823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.240922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.241127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.241219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.241468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.241566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.241808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.241905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.242115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.242720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.242963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.243070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.243282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.243381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.243589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.243680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.243894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.244000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.244199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.244298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.244506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.244596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.244822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.244930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.246124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.246251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.246341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.246425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.246517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.246619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.246706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.246881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.247028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.247118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.247218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.247313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.247398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.247489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.247580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.247671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.247815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.247908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.248001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.248094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.248186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.248278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.248376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.248492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.248623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.248804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.248919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.249131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.249233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.249447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.249547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.249773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.249876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.250081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.250184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.250388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.250482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.250699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.250798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.251017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.251115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.251322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.251426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.251627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.251732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.251930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.252023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.252235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.252328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.252556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.252661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.252861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.252953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.253164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.253256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.253484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.253577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.253808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.253920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.254114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.254223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.254429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.254531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.254734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.254826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.255037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.255139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.255355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.255449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.255655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.255748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.255956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.256056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.256261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.256353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.256560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.256651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.256873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.256999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.257201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.257311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.257459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.257552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.257814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.257991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.258154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.258257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.258525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.258666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.258829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.258943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.259095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.259187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.259397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.259484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.259706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.259826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.260012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.260113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.260311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.260403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.260612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.260713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.260974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 14:11:31.261079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.261316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.261405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.261651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.261759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.262021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.262378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.262990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.263973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.264056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.264330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.264420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.264608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.264700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.264917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.265006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.265225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.265306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.265540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.265636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.266946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.267109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.267243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.267447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.267574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.267720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.267841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.268093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.268190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.268412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.268499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.268757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.268871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.269082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.269184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.269444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.269545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.269794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.269892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.270108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.270203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.270436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.270536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.270758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.270851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.271065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.271170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.271377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.271470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.271695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.271793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.272007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.272110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.272317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.272667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.272906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.273013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.273223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.273325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.274102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.274195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.274457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.274538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.274791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.274955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.275145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.275245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.275461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.275553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.275776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.275878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.276107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.276214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.276424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.276523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.276738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.276838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.277075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.277170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.277470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.277573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.277787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.277880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.278069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.278163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.278399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.278491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.278716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.278815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.279063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.279177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.279412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.279506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.279777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.279871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.280089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.280203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.280436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.280548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.280743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.280831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.281078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.281158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.281428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.281532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.281785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.281897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.282099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.282191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.282411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.282518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.282723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.282823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.283949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.284982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.285181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.285283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.285502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.285600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.285828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.285972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.286196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.286308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.286450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.286547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.286759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.286852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.287068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.287169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.287376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.287475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.287680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.287779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.288934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.289025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.289825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.290089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.290211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.290419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.290579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.290748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.290861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.291998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.292089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.292298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.292389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.292604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.292889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.292988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.293199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.293290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.293503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.293594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.293829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.293925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.294136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.294230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.294440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.294547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.294743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.294844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.295986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.296086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.296292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.296420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.296632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.296732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.296936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.297986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.298207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.298317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.298517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.298617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.298825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.298917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.299135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.299229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.299445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.299568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.299752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.299843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.300997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.301091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.301308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.301408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.301612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.301703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.301946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.302048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.302253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.302345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.302599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.302705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.302922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.303021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.303264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.303361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.303601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.303952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.304280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.304365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.304592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.304745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.304955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.305053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.305339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.305435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.305576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.305687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.305907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.306046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.306217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.306403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.306535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.306669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.306845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.307036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.307163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.308971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.309935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.310065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.310253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.310352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.310563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.310657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.311905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.312103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.312185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.312413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.312509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.312718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.312818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.313978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.314997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.315204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.315306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.315518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.315619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.315824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.315925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.316130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.316222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.316457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.316613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.316746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.316848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.317998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.318150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.318302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.318395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.318611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.318712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.318913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.319943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.320149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.320242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.320502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.320598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.320820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.321862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.322086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.322190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.322397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.322486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.322702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.322803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.323949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.324982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.325187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.325280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.325496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.325596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.325833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.325938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.326144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.326408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.326500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.326748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.326839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.327067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.327165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.327375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.327468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.327684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.327788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.328966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.329997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.330204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.330306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.330514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.330615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.330819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.330920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.331127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.331239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.331430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.331573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.331737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.331840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.332080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.332182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.332387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.332494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.332688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.332785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.333128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.333229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.333304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.333375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.333593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.333969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.334280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.334417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.334603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.334742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.334912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.335069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.335218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.335378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.335523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.335696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.335826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.336525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.336764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.336866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.337007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.337232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.337351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.337553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.341772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.341916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.342995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.343973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.344998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.345966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.346995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.347102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.347310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.347415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.347613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.347718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.347936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.348962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.349169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.349289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.349470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.349568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.349932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.350835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.351301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.351404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.351495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.351594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.351726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.352333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.353627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.354986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.355695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.356608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.356733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.356825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.356909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.356984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.357943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.358077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.358211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.361830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.361940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.362992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.363974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.364984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.365943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.366022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.366125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.366234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.370990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.371986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.372921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.373822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.375503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.375614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.375701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.375777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.375850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.375931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.376520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.377423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.377511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.377593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.377668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.377844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.377844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.378878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.379729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.379836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.379921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.379996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.380103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.380627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.380794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.380951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.381105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.381269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.381446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.381603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.381778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.381941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.382107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.382286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.382447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.382602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.382756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.383519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.383767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.384049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.384242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.384422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.384587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.384750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.384906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.385077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.385234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.385404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.385561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.385561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.385960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.386117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.386291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.386456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.387092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.387273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.387443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.387611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.387776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.387932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.388087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.388241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.388411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.388577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.388778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.388948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.389159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.389328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.389486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.389657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.389851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.390009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.390165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.390598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.390768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.390925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.391083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.391249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.391419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.391588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.391753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.391753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.392058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.392213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.392367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.392536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.392706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.392869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.393033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.393200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.393377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.393802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.393980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.394138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.394294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.394457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.394623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.394788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.394944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.395100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.395261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.395417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.395583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.395762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.395762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.396061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.396061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.396410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.396583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.397895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.398086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.398246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.398401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.399473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.399854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.400045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.400227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.400735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.400905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.401075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.401075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.401383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.401539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.401701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.401893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.402103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.402270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.402426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.402601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.402772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.402979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.403145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.403310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.403473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.403637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.403800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.403975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.404138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.404303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.404465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.404628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.404795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.404961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.405125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.405287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.405450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.405620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.405824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.406979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.407430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.407603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.407770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.407927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.408092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.408248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.408403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.408568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.408731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.408896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.409066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.409275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.409528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.409690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.409872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.410040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.410210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.410367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.410533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.410934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.411106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.411273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.411429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.411593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.411761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.411918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.412081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.412248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.412403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.412403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.412716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.412716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.413025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.413190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.413345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.413502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.413665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.413920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.414111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.414370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.414643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.414643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.415061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.415229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.415394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.415569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.415735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.415893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.416048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.416210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.416393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.416550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.416721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.416878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.417033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.417188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.417619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.417619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.418057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.418217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.418372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.418527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.418708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.418873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.419030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.419192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.419393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.419659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.419829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.419987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.420152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.420316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.420471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.420636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.421064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.421246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.421403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.421558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.421713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.421909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.422078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.422244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.422399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.422563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.422736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.422904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.423068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.423235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.423391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.423554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.423721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.423893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.424050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.424213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.424377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.424540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.424709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.424873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.425037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.425209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.425375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.425541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.425705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.425885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.426042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.426208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.426373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.426540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.426704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.426868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.427031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.427198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.427354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.427786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.427951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.428108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.428272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.428437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.428602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.428602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.428900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.429054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.429209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.429364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.429593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.430196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.430377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.430599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.430785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.430960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.431388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.431388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.431711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.431869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.432032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.432204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.432385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.432550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.432715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.432879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.433054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.433295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.433461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.433626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.433813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.433986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.434964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.435278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.435278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.435585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.435749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.435924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.436675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.436854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.437012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.437188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.437346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.437504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.437912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.438085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.438250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.438415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.438579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.438744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.438916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.439082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.439238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.439394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.439607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.439783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.439940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.440103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.440348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.440519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.440676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.440847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.441004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.441168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.441168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.441777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.441953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.442137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.442302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.442459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.442633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.442790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.442951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.443121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.443279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.443434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.443597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.443761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.443932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.444087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.444255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.444410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.444565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.444720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.444889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.445054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.445220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.446018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.446259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.446462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.446631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.446800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.447012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.447181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.447339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.447495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.447660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.447926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.448163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.448327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.448492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.448658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.448822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.448978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.449142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.449309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.449467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.449680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.449863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.450020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.450187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.450369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.450369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.451925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.452101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.452262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.452427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.452586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.452761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.452945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.453102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.453258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.453428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.453591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.453801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.453967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.454124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.454124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.454420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.454575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.454759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.454924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.455080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.455235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.455390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.455544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.455715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.455871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.456027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.457226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.457407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.457578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.457767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.458173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.458551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.458719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.458878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.459109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.459298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.459457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.459621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.459826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.460004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.460176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.460341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.460510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.460778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.460942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.461260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.461476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.462994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.463298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.463467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.463641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.463815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.463979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.464137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.464292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.464456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.464612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.464783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.464937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.465095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.465257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.465424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.465589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.465774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.465948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.466105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.466546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.466711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.466895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.467554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.467731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.467898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.468301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.469592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.471008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.473675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.475191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.477461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.478957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.480180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.481452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.484122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.484122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.484122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.484122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.484122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 14:11:31.484122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 14:11:31.546381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Registered counter for database nova_api Sep 13 14:11:31.567914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.575748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.606033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Registered counter for database nova_api Sep 13 14:11:31.625810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.632419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.context [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),98002c82-0fa6-4467-9ed3-a3065eaa8d97(cell1) {{(pid=120643) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 14:11:31.632572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.637254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:11:31.637753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:11:31.639417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:11:31.640169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:11:31.640629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:11:31.642705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:11:31.644709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Registered counter for database nova_cell0 Sep 13 14:11:31.649786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Registered counter for database nova_cell1 Sep 13 14:11:31.657104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.658811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.664948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.667043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.690973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.context [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),98002c82-0fa6-4467-9ed3-a3065eaa8d97(cell1) {{(pid=120642) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 14:11:31.694852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:11:31.695849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:11:31.697577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:11:31.698348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:11:31.698804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:11:31.700822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:11:31.702840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Registered counter for database nova_cell0 Sep 13 14:11:31.706869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Registered counter for database nova_cell1 Sep 13 14:11:31.715039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.716700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.723765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.724103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.816502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO dbcounter [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Registered counter for database nova_cell0 Sep 13 14:11:31.823564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_db.sqlalchemy.engines [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.828017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writer thread running {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:31.871142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO dbcounter [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Registered counter for database nova_cell0 Sep 13 14:11:31.877682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_db.sqlalchemy.engines [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 14:11:31.882314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writer thread running {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 14:11:32.154614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:11:32.162315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:11:32.205904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:11:32.214175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:11:32.513116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:11:32.519424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: WARNING keystonemiddleware.auth_token [None req-6f6bdb79-49e0-4e51-8cdb-706c11104625 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:11:32.526219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f33d06e9c0 pid: 120643 (default app) Sep 13 14:11:32.572034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 14:11:32.578127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: WARNING keystonemiddleware.auth_token [None req-d8020ea6-a644-4301-ae52-8b9a5502b07a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 14:11:32.583448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f33d06e9c0 pid: 120642 (default app) Sep 13 14:12:09.092809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:09.094402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:09.095721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:09.097031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:10.590890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-117a9721-f066-4783-a917-6b40fc892002 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Action: 'create', calling method: .version_select at 0x7fc9d50e0430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-914417654", "metadata": {"Type": "work"}}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:12.488573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-117a9721-f066-4783-a917-6b40fc892002 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.412068 Sep 13 14:12:12.514697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Sep 13 14:12:09 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3441 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 14:12:12.867832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4bd549f2-38f1-4919-ad82-df27e1191441 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Calling method '.version_select at 0x7fc9d511ef70>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:12.898411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:12.899594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:12.901122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:12.902545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:13.062846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de378546-b4dc-4ac7-9e31-70eb65ba868d tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4fb2310>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:13.136965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de378546-b4dc-4ac7-9e31-70eb65ba868d tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/d12d61a5-04f7-4bfe-b189-615097a6958d" status: 200 len: 350 microversion: 2.1 time: 0.079639 Sep 13 14:12:13.137857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2/2] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:13 2022] GET /compute/v2.1/os-volumes/d12d61a5-04f7-4bfe-b189-615097a6958d => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:12:13.262634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4bd549f2-38f1-4919-ad82-df27e1191441 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d" status: 200 len: 353 microversion: 2.1 time: 0.751000 Sep 13 14:12:13.263430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1/3] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:12 2022] GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d => generated 353 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:13.279021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53b5fdf0-895d-43dc-b836-a9da46256812 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Calling method '.version_select at 0x7fc9d4fb2a60>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:13.352158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53b5fdf0-895d-43dc-b836-a9da46256812 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d" status: 200 len: 353 microversion: 2.1 time: 0.078083 Sep 13 14:12:13.353119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:13 2022] GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:13.375847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18f738cc-39b2-4b86-8de8-f736a480a50d tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Calling method '.version_select at 0x7fc9d4fc3310>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:13.679179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18f738cc-39b2-4b86-8de8-f736a480a50d tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d" status: 202 len: 0 microversion: 2.1 time: 0.308170 Sep 13 14:12:13.679939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2/5] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:12:13 2022] DELETE /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:12:13.688099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3dad317e-8230-4c9d-82e0-06f17351d5f8 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Calling method '.version_select at 0x7fc9d4f4d160>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:13.849357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3dad317e-8230-4c9d-82e0-06f17351d5f8 tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d" status: 200 len: 352 microversion: 2.1 time: 0.164871 Sep 13 14:12:13.853186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:13 2022] GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:14.868205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b85d29c3-4c7c-4f97-a076-42cc332bc06a tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Calling method '.version_select at 0x7fc9d4fc3550>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:14.924311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-b85d29c3-4c7c-4f97-a076-42cc332bc06a tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] HTTP exception thrown: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b85d29c3-4c7c-4f97-a076-42cc332bc06a tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Request method failure captured: Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d HTTP/1.1 Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII-4UMKr9Otj4lSySSNcxpvGWtpFCNpZq6yD34uEoqIpkZ8c4YCoktFzBq8fsvDlPSkBs8XDftrkTyI3B_GNYlSkqco4XdV6lW9nBLS-4Akfhd7J5AciZe8vdUMemcJbpchvLB7_DplMKxeP70RgI0n8lvArqjvfKHhOqnIaWVXof28 Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 5a575c06adfd4cb8a6722de49994004c Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesGetTestJSON-28071285 Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:12:14.929618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a575c06adfd4cb8a6722de49994004c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5a575c06adfd4cb8a6722de49994004c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5a575c06adfd4cb8a6722de49994004c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5a575c06adfd4cb8a6722de49994004c"}]}] Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesGetTestJSON-28071285 Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 5a575c06adfd4cb8a6722de49994004c Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesGetTestJSON-28071285 Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesGetTestJSON-28071285-project Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: d35f22e67dbc4f9e9144596860b21e79 Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesGetTestJSON-28071285-project Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '46b77516-8a07-4aba-bec9-aea2fd9f8f7d'} Sep 13 14:12:14.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. (HTTP 404) (Request-ID: req-71391917-932f-499f-8263-0ad7cd78bb49) Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:12:14.931445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:12:14.932384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 14:12:14.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. Sep 13 14:12:14.934348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:12:14.940118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b85d29c3-4c7c-4f97-a076-42cc332bc06a tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] Returning 404 to user: Volume 46b77516-8a07-4aba-bec9-aea2fd9f8f7d could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:12:14.941327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b85d29c3-4c7c-4f97-a076-42cc332bc06a tempest-VolumesGetTestJSON-28071285 tempest-VolumesGetTestJSON-28071285-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d" status: 404 len: 109 microversion: 2.1 time: 0.078912 Sep 13 14:12:14.945921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:14 2022] GET /compute/v2.1/os-volumes/46b77516-8a07-4aba-bec9-aea2fd9f8f7d => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:12:14.987968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2d8f155-ff8d-42c2-84ac-2e4cf5df8782 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4fb2d30>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:15.061382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2d8f155-ff8d-42c2-84ac-2e4cf5df8782 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/cc5cc3cc-5c3f-4038-be0e-0f8123d17c30" status: 200 len: 350 microversion: 2.1 time: 0.078697 Sep 13 14:12:15.082782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:14 2022] GET /compute/v2.1/os-volumes/cc5cc3cc-5c3f-4038-be0e-0f8123d17c30 => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:16.867907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-423bc542-3325-4b8d-9b54-6e35caaf0e34 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4fb2430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:16.917249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7cf9b36-41ed-4c24-af1f-eff09596556d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'create', calling method: .version_select at 0x7fc9d58c91f0>, body: {"keypair": {"name": "tempest-keypair-532385695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgyilXOwXeVzzqqqJxoDj2bqYzxzjraCCIXvmb/rlHiJDJDCELFD0/v0wyUlM7oBDjupgJgqlhOH9Hn5LYUq+Hkwggly1CInOhLaO/JqPuce8w9gktBLl3kwbu8Gyw87Q=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:16.961921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-423bc542-3325-4b8d-9b54-6e35caaf0e34 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/129e34c7-3db3-4915-b174-6d31f232c2c9" status: 200 len: 348 microversion: 2.1 time: 0.098146 Sep 13 14:12:16.962489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 6/9] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:12:16 2022] GET /compute/v2.1/os-volumes/129e34c7-3db3-4915-b174-6d31f232c2c9 => generated 348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:12:16.976298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d50011d-3b88-47ae-a70e-a982565891f9 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4f4d3a0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:17.073574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-e7cf9b36-41ed-4c24-af1f-eff09596556d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for project e206bc45915744e29dcb918218fa3416. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:17.090120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-e7cf9b36-41ed-4c24-af1f-eff09596556d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for user 92c30fba107b4dfbb7b7b1582cee2ae8 and project e206bc45915744e29dcb918218fa3416. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:17.163355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d50011d-3b88-47ae-a70e-a982565891f9 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.191326 Sep 13 14:12:17.164002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 7/10] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 13 14:12:16 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:17.165412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7cf9b36-41ed-4c24-af1f-eff09596556d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.505307 Sep 13 14:12:17.166119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 4/11] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 13 14:12:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 507 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 14:12:17.180379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75121dbf-462f-4cdd-89f4-8cf18f910f8c tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4fb24c0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:17.334502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75121dbf-462f-4cdd-89f4-8cf18f910f8c tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.157756 Sep 13 14:12:17.335214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 8/12] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Sep 13 14:12:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:17.356600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-51d5ea6a-a566-4f1f-934d-69494c0a730f tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4eb65e0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:17.540109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-51d5ea6a-a566-4f1f-934d-69494c0a730f tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1031 microversion: 2.1 time: 0.192153 Sep 13 14:12:17.541035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 5/13] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Sep 13 14:12:17 2022] GET /compute/v2.1/os-volumes => generated 1031 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:17.555611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afaee804-845c-4dac-bd47-38f692aa0904 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4f4d8b0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:17.763042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afaee804-845c-4dac-bd47-38f692aa0904 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.212623 Sep 13 14:12:17.763982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 9/14] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Sep 13 14:12:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:17.779312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7222d101-e71a-40b7-ae18-b90f7fc15bbd tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4e68c10>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:18.052618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7222d101-e71a-40b7-ae18-b90f7fc15bbd tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 691 microversion: 2.1 time: 0.277457 Sep 13 14:12:18.053711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 6/15] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Sep 13 14:12:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 691 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:18.068957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d521f1b-eac1-4fb9-8511-14bb638d3f2b tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4f4d160>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:18.330240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d521f1b-eac1-4fb9-8511-14bb638d3f2b tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.265730 Sep 13 14:12:18.331336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 10/16] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 13 14:12:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:18.349074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ce84665-c1d9-4963-84bd-0a9306fc32c5 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4eb6940>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:18.578680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ce84665-c1d9-4963-84bd-0a9306fc32c5 tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.236451 Sep 13 14:12:18.580142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 7/17] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Sep 13 14:12:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:18.593362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aad231de-975e-4c13-9264-1de3e180476d tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] Calling method '.version_select at 0x7fc9d4fb2a60>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:18.772034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aad231de-975e-4c13-9264-1de3e180476d tempest-VolumesTestJSON-1967169905 tempest-VolumesTestJSON-1967169905-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1031 microversion: 2.1 time: 0.177388 Sep 13 14:12:18.779833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 11/18] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Sep 13 14:12:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1031 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:24.500272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da97696d-10ee-4fa9-885a-96e5eda8906e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'create', calling method: .version_select at 0x7fc9d4e68310>, body: {"keypair": {"name": "tempest-keypair-1551317523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoGw391OKE69J6WaJKCPuKcNneOOdGBq6WovrDR4SdjAy4dErvbTVP/+n0hRjz284+JQGOyjb1r+Yv1fAqklilBDAuAj1ZIWhMxv4RfycXe8WUo1na1EmfhhbIpGXnHvg=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:24.572750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-da97696d-10ee-4fa9-885a-96e5eda8906e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:24.589090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-da97696d-10ee-4fa9-885a-96e5eda8906e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for user 17e8dbc75366467f8fc6f0681e722751 and project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:24.652168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da97696d-10ee-4fa9-885a-96e5eda8906e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.562106 Sep 13 14:12:24.652708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 8/19] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:12:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:26.303315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1797647372", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:26.523749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] validate_networks() for [('331e6015-f29a-4324-85ce-4db46e43b03f', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:12:28.589553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-111965023", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd22de2d-248b-4379-b54f-b96ce438f36c"}], "security_groups": [{"name": "tempest-securitygroup--1868581911"}], "key_name": "tempest-keypair-532385695", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:29.556033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] validate_networks() for [('fd22de2d-248b-4379-b54f-b96ce438f36c', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:12:30.080821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:12:30.081318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:12:30.081774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:12:30.082360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:12:30.082945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:12:30.124054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:30.124550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:30.124991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:30.125755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:30.132755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:30.134808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:30.201203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:30.254291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for user 961012089bd147ecab4fcdf5ea3ae4c3 and project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:30.300729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:12:30.310677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:12:30.499131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cd9b597-fc96-4d62-9ab2-8583e980543b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.489073 Sep 13 14:12:30.512859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 12/20] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:12:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 4503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:12:30.527554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5f219ac-2c8e-4a96-8802-922081975dc5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:30.537106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5f219ac-2c8e-4a96-8802-922081975dc5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:30.816581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d5f219ac-2c8e-4a96-8802-922081975dc5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:30.841809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5f219ac-2c8e-4a96-8802-922081975dc5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1222 microversion: 2.1 time: 0.322425 Sep 13 14:12:30.843411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 13/21] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:30 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1222 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:31.145706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-575729948", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:31.337429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] validate_networks() for [('331e6015-f29a-4324-85ce-4db46e43b03f', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:12:32.296405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:12:32.297094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:12:32.297389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:12:32.297836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:12:32.298327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:12:32.331860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:32.332347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:32.332786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:32.357561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:32.358125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:32.358577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:32.430135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:32.454559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for user 961012089bd147ecab4fcdf5ea3ae4c3 and project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:32.520513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:12:32.527986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:12:32.663789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0da5057-125f-46ad-93b6-30368900198f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.523311 Sep 13 14:12:32.668555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 14/22] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:12:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:12:32.686364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-247630873", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c8c757b-f3e9-4af8-9cb9-a872eae893ed"}], "security_groups": [{"name": "tempest-securitygroup--2081814324"}], "key_name": "tempest-keypair-1551317523", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:33.162062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] validate_networks() for [('0c8c757b-f3e9-4af8-9cb9-a872eae893ed', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:12:33.536824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:12:33.537561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:12:33.538393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:12:33.538686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:12:33.539105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:12:33.559237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:33.559762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:33.562708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:33.563370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:33.563869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:33.593719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:33.701311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for project e206bc45915744e29dcb918218fa3416. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:33.725461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for user 92c30fba107b4dfbb7b7b1582cee2ae8 and project e206bc45915744e29dcb918218fa3416. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:33.780379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:12:33.783390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:12:34.027939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8e83150c-fcee-432b-acf5-d38ed5445799 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.436483 Sep 13 14:12:34.028413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 9/23] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 13 14:12:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 5444 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 14:12:34.503246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:12:34.503710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:12:34.504189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:12:34.504602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:12:34.506088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:12:34.541024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:34.543930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:34.544320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:34.545142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:34.550398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:34.551874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:34.588735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:34.596287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for user 17e8dbc75366467f8fc6f0681e722751 and project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:34.651936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:12:34.654532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:12:34.759242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1971afee-0f49-460b-8c45-30dabc3b8704 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.088993 Sep 13 14:12:34.761909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 15/24] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:12:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:12:34.784737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:34.785936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:34.800665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:34.801574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:34.806648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:34.808972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:34.810257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:34.812327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:34.828474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-73aaa10f-d81d-4933-bafa-d92d4125b1da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: .version_select at 0x7fc9d4da1040>, body: {"keypair": {"name": "tempest-keypair-1840970379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK613MRHW+i7uCx/+EC7oQ/8g57I8yoEUwwBCEZEP7xZfoDbcaXWbKUi4iYxA6bBUzyWuNsInxmhdePBXzkBel5AgFFrxoflHtngu6kyAKsJ3WBhhZgedf7atD7x86rH3A=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:34.900357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-73aaa10f-d81d-4933-bafa-d92d4125b1da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:34.919845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-73aaa10f-d81d-4933-bafa-d92d4125b1da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:34.980555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-73aaa10f-d81d-4933-bafa-d92d4125b1da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.950578 Sep 13 14:12:34.981589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 10/25] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:12:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:34.995605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a59b9b97-7ce6-4cf0-851e-fe3df7b2d253 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:34.996471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a59b9b97-7ce6-4cf0-851e-fe3df7b2d253 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:35.435674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a59b9b97-7ce6-4cf0-851e-fe3df7b2d253 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:35.492607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a59b9b97-7ce6-4cf0-851e-fe3df7b2d253 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:35.494143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a59b9b97-7ce6-4cf0-851e-fe3df7b2d253 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:35.495319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a59b9b97-7ce6-4cf0-851e-fe3df7b2d253 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1280 microversion: 2.20 time: 0.504277 Sep 13 14:12:35.530774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 11/26] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1280 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:35.946614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:35.979082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-479eb70e-5000-4e43-b806-62e40b827c16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1225 microversion: 2.1 time: 1.210280 Sep 13 14:12:35.981238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 16/27] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:34 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1225 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:35.993609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76c7c46d-0fde-4eaa-8981-5c053efc8985 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:35.998265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76c7c46d-0fde-4eaa-8981-5c053efc8985 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:36.125668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1141513656", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "networks": [{"uuid": "dfcbb00c-bacd-410e-9e68-85a2dbf1f040"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:36.166982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76c7c46d-0fde-4eaa-8981-5c053efc8985 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:36.175948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76c7c46d-0fde-4eaa-8981-5c053efc8985 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1237 microversion: 2.1 time: 0.193275 Sep 13 14:12:36.182941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 17/28] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1237 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:36.539452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:36.540143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:36.557655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:36.561372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:36.580898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:36.584401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:36.585939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:36.587492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:37.131844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:37.148068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:37.152343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:37.161297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adfe95b5-4737-4553-bd32-c7caf7073990 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1276 microversion: 2.20 time: 0.627337 Sep 13 14:12:37.178379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 18/29] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1276 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:37.187129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:37.188253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:37.221169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:37.245429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:37.248015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:37.249026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:37.251477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:37.262473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:37.708150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:37.721631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3de160ec-5cef-4007-9495-c26c4ed5de65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1291 microversion: 2.1 time: 0.547124 Sep 13 14:12:37.722533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 19/30] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:37 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1291 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:37.734089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:37.743731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:37.785772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:37.793232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:37.796881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:37.799708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:37.812113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:37.814259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:38.463715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:38.475816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6017e108-5208-4c5f-a1f7-69f21bc90737 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1233 microversion: 2.1 time: 0.749977 Sep 13 14:12:38.482712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 20/31] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1233 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:38.487676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:38.498641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:38.506848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:38.513451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:38.514292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:38.515341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:38.516093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:38.516802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:38.736765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:38.753139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:38.759202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:38.762474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc0a4711-b12d-49f3-b06e-cf898c3111c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1350 microversion: 2.20 time: 0.277913 Sep 13 14:12:38.764644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 21/32] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1350 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:38.791860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:38.796772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:38.810394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:38.812314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:38.814601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:38.820310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:38.821758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:38.824958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:39.010621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:39.022202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0efc86d-ca5e-4cab-ada0-198d8bf7c4ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1279 microversion: 2.1 time: 0.253314 Sep 13 14:12:39.036669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 22/33] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:38 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1279 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:39.504326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:39.505133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:39.514652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:39.529829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:39.530307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:39.538919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:39.539356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:39.539801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:39.815712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:39.830870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-303617a8-d7c3-443e-961a-e5d08fd502f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1307 microversion: 2.1 time: 0.330195 Sep 13 14:12:39.832305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 23/34] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:39.839214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:39.840009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:39.847114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:39.848315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:39.849675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:39.850681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:39.851289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:39.851964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:40.040705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:40.066271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:40.068653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:40.082680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-faf149d9-7037-4f7b-8342-b206bfae8ae5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1338 microversion: 2.20 time: 0.235766 Sep 13 14:12:40.085020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 24/35] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1338 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:40.118083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:40.126016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:40.178499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:40.179193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:40.179651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:40.185286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:40.185830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:40.191048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:40.466164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:40.490160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-782d0e71-7ced-4713-9672-2bb46794cc1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1279 microversion: 2.1 time: 0.403644 Sep 13 14:12:40.513608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 25/36] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:40 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1279 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:40.859680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:40.860523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:40.872392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:40.879295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:40.881903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:40.885108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:40.886907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:40.888738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:41.319466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:41.328601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bc6a6efb-1f99-49f8-b327-a5bd218b07a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1295 microversion: 2.1 time: 0.473725 Sep 13 14:12:41.329382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 26/37] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1295 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:12:41.336745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:41.343207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:41.360458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:41.361202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:41.361909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:41.362958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:41.363572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:41.364225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:41.831790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:41.843487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:41.849986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:41.855392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae927c71-e837-4f23-af67-1efc125383b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1338 microversion: 2.20 time: 0.524433 Sep 13 14:12:41.857256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 27/38] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1338 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:41.873112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:41.874165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:41.881444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:41.895951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:41.896725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:41.897577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:41.900233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:41.900911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:42.789240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:42.804759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d3d3b3b-4e24-42be-bd99-6bfecdecf6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.946145 Sep 13 14:12:42.806348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 28/39] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:41 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:42.837662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:42.839369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:42.875800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:42.877981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:42.883035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:42.887835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:42.890856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:42.894327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:43.259700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:43.293229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a85bade6-3b2b-485c-bb5a-1df7c16e3019 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1295 microversion: 2.1 time: 0.481204 Sep 13 14:12:43.296175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 29/40] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1295 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:43.328536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:43.329283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:43.370156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:43.371084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:43.375506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:43.384606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:43.385460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:43.386409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:43.631441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:43.632264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:43.709790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:43.728566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:43.730432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:43.736604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ffab36f-8655-4e8f-bcd3-ec299aea9b09 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1338 microversion: 2.20 time: 0.439321 Sep 13 14:12:43.737740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 30/41] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1338 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:43.839242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:43.840670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:43.854751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:43.855508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:43.856352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:43.857273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:43.857990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:43.858623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:44.575497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:45.210675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:45.224883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-498922fd-e501-4146-a300-dcd8011e4f68 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 1.389370 Sep 13 14:12:45.226945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 31/42] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:43 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:12:45.245479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:45.254565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:45.275222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:45.275733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:45.280982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:45.283871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:45.287412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:45.290413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:45.355234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:45.472196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=20 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:46.166536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:46.172019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=22 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:46.231863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:46.250826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66ccba5d-1612-49ab-bf61-24a4d92e7fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 1.020185 Sep 13 14:12:46.252525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 32/43] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:46.283434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1473874356", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90f85b86-6272-4c59-ab80-1d663e05af5b"}], "security_groups": [{"name": "tempest-securitygroup--10401042"}], "key_name": "tempest-keypair-1840970379", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:50.076438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] validate_networks() for [('dfcbb00c-bacd-410e-9e68-85a2dbf1f040', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:12:50.135120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] validate_networks() for [('90f85b86-6272-4c59-ab80-1d663e05af5b', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:12:50.693610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:12:50.694632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:12:50.695621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:12:50.696532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:12:50.697833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:12:50.714388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:50.715274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:50.716397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:50.717539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:50.718235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:50.718805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:50.745319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Getting quotas for project a66ebe0eb0ec44fa8fb3ed62d27f9599. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:50.751116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Getting quotas for user e35dfe8442964bd793276386c2fe6f95 and project a66ebe0eb0ec44fa8fb3ed62d27f9599. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:50.764868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:12:50.767866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:12:50.776693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:12:50.777464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:12:50.778401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:12:50.779039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:12:50.779815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:12:50.791021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:50.791670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:50.792359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:50.793368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:50.794134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:50.794593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:50.813754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:12:50.829569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:50.831960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:12:50.849287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:12:50.852377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:12:50.858963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67683de2-29e7-42dd-87d0-acd00c345b0d tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 15.327475 Sep 13 14:12:50.867873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 12/44] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:12:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 15330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:12:50.874108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:50.877857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:50.917129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:50.917628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:50.918088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:50.923828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:50.928025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:50.930797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:50.988266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36a74e7a-4d4e-42f5-b066-f0e5015bef29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 4.733441 Sep 13 14:12:50.998534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 33/45] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:12:46 2022] POST /compute/v2.1/servers => generated 400 bytes in 4744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:12:51.210142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1791b49a-ae8a-4b9d-a575-dc20ba423604", "tag": "a9685535-ba6f-4ba1-9ad0-05089e69c294"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:51.273680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.274195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.279037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.314513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Creating event network-changed:a9685535-ba6f-4ba1-9ad0-05089e69c294 for instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 on hv-cinder-85743 Sep 13 14:12:51.315267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 14:12:51.315794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ededea3e-12d6-4899-bfd2-73d87a9dd2bf req-389ad16e-3db0-4a78-9c4b-292d9abd81bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 14:12:51.317316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.317816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.318476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.319205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.319970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.320397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.334569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.compute.rpcapi [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 14:12:51.337126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] Releasing lock "compute-rpcapi-router" {{(pid=120643) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 14:12:51.337772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.364682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.366314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.367627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b1192641-6749-43ba-b10e-fb50a82122b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.505910 Sep 13 14:12:51.368324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 13/46] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:51.380925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddfe7b8f-6b01-48f9-b24d-954be88bfbc7 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378679 Sep 13 14:12:51.388244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:51.388474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 34/47] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:51.393836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:51.407797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.408603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.413515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.415097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.424970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.426077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.610542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.637083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6be1b3f8-17e2-4cd9-9129-d91d70f4712f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.267256 Sep 13 14:12:51.637791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 14/48] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:51 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:51.651621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-fa3fdcbe-44e7-42b0-b6e9-373f5e3ba237 req-98ab1895-21e1-4a97-a709-ff9f4b9e0457 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92521eb-7555-438a-9c2c-463107546a43", "tag": "e5c55372-27ef-4a81-9b64-fe1b11dc0ef0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:51.653419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:51.654263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:51.662776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.665443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.666142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.667066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.667300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa3fdcbe-44e7-42b0-b6e9-373f5e3ba237 req-98ab1895-21e1-4a97-a709-ff9f4b9e0457 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.668075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa3fdcbe-44e7-42b0-b6e9-373f5e3ba237 req-98ab1895-21e1-4a97-a709-ff9f4b9e0457 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.668725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.669977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-fa3fdcbe-44e7-42b0-b6e9-373f5e3ba237 req-98ab1895-21e1-4a97-a709-ff9f4b9e0457 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.670546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.685828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-fa3fdcbe-44e7-42b0-b6e9-373f5e3ba237 req-98ab1895-21e1-4a97-a709-ff9f4b9e0457 service nova] Creating event network-changed:e5c55372-27ef-4a81-9b64-fe1b11dc0ef0 for instance c92521eb-7555-438a-9c2c-463107546a43 on hv-cinder-85743 Sep 13 14:12:51.692343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-fa3fdcbe-44e7-42b0-b6e9-373f5e3ba237 req-98ab1895-21e1-4a97-a709-ff9f4b9e0457 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.302245 Sep 13 14:12:51.693468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 35/49] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:51.700721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:51.702327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:51.711122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.711622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.712064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.713101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.713590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.714208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.800412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.809820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f63954b-7ecd-4ec2-9ff5-6972e081b468 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1219 microversion: 2.1 time: 0.113733 Sep 13 14:12:51.811512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 36/50] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:51 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:51.833921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:51.834528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:51.841048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.841550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.841986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.842682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:51.843158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:51.843695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:51.918514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.921574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:51.930645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9e8effe-f95a-4e7d-a8f2-49eedcf47c6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1246 microversion: 2.1 time: 0.101278 Sep 13 14:12:51.931172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-069e6c95-9fed-44b2-ae93-17f8729a454c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.292171 Sep 13 14:12:51.931995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 37/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:51.938288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 15/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:52.394101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:52.395623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:52.403478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.404364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.405012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.406006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.407220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.407895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.579723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:52.588877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:52.590463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:52.591560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c5dcbf9-2efc-40f3-a38c-9c4fcf04f96e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.202154 Sep 13 14:12:52.592129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 38/53] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:52.662750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:52.663358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:52.669676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.670191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.670621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.671309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.671764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.672187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.799869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:52.807473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c565fed3-78bd-4186-b091-5cba7cf8622e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.149378 Sep 13 14:12:52.808031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 16/54] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:52 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:52.836434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:52.837065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:52.842855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.843331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.843758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.844432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.844881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.845298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.909083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:52.919576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0266c514-ebe6-4b40-bdbc-c01ff65a552c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1211 microversion: 2.1 time: 0.087250 Sep 13 14:12:52.920194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 39/55] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:52 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:52.956742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:52.957932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:52.964651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.965229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.965793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.966554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.966660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:52.967156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.967299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:52.967705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.974145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.974631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.975069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:52.975764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:52.976219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:52.976640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.029841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:53.038076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d2ed6596-317e-4172-a75c-3161399fe2aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1238 microversion: 2.1 time: 0.085588 Sep 13 14:12:53.038648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 17/56] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:53.106716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:53.114375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c151013b-b55a-4704-af79-2a0888a68f24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.151555 Sep 13 14:12:53.114936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 40/57] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:53.398560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c77e04fe-3528-40f8-8efb-515a6abe4a83", "tag": "7edcac2b-89f0-4449-b10d-3e2dbafe596d"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:53.412459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.413200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.413815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.435136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Creating event network-changed:7edcac2b-89f0-4449-b10d-3e2dbafe596d for instance c77e04fe-3528-40f8-8efb-515a6abe4a83 on hv-cinder-85743 Sep 13 14:12:53.435891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 14:12:53.436504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-d47816ad-1c4a-4c98-bb00-494597eb19d5 req-3f922938-6e42-4754-a66a-7f706e1b755b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 14:12:53.437612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.438301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.438935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.439848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.440502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.441137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.451743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.compute.rpcapi [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 14:12:53.453311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] Releasing lock "compute-rpcapi-router" {{(pid=120642) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 14:12:53.484675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5db15350-b95d-45da-a219-fabc6213b0e5 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089586 Sep 13 14:12:53.484675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 18/58] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:53.617074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:53.617697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:53.623616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.624106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.624552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.625247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.626534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.627186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.759088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-3622beae-9056-4ba0-8e32-d3c97a07832a req-9fc9dd0a-9bf1-4e19-b8ad-023ddcd90b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:53.771852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:53.780129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:53.783865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-3622beae-9056-4ba0-8e32-d3c97a07832a req-9fc9dd0a-9bf1-4e19-b8ad-023ddcd90b34 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.784353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-3622beae-9056-4ba0-8e32-d3c97a07832a req-9fc9dd0a-9bf1-4e19-b8ad-023ddcd90b34 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.784785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-3622beae-9056-4ba0-8e32-d3c97a07832a req-9fc9dd0a-9bf1-4e19-b8ad-023ddcd90b34 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.787864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:53.787864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a27755f1-a8fa-4eb3-8a28-c8e2d2b396a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.175250 Sep 13 14:12:53.788598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 41/59] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:53.812874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-3622beae-9056-4ba0-8e32-d3c97a07832a req-9fc9dd0a-9bf1-4e19-b8ad-023ddcd90b34 service nova] Creating event network-changed:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:12:53.820181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-3622beae-9056-4ba0-8e32-d3c97a07832a req-9fc9dd0a-9bf1-4e19-b8ad-023ddcd90b34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066192 Sep 13 14:12:53.821598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 19/60] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:12:53.833056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:53.833678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:53.846356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.846843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.847280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.847988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:53.848913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:53.849342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:53.979326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:53.980077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:54.012880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.013422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.021058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.022607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.023092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.023530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.217801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:54.227058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19e676c3-774d-4f82-809a-b0a555206a9c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1211 microversion: 2.1 time: 0.287352 Sep 13 14:12:54.247204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 20/61] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:53 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1211 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:54.252827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:54.253806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:54.261318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.262298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.263008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.263947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.264701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.265362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.499870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:54.510168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48f9e6f3-c970-46b5-b83c-db88d1ba5b34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1294 microversion: 2.1 time: 0.261547 Sep 13 14:12:54.510856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 21/62] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1294 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:54.515474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:54.516486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:54.525756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.526698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.527352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.528703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.529354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.529982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.581109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:54.590025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6373dc93-8ee4-47d0-8ba7-3a646fb73b5f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.764166 Sep 13 14:12:54.590857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 42/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:53 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:12:54.677111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:54.684908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-afe7c70d-57c8-4b05-819c-0e7d72040933 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.173036 Sep 13 14:12:54.685563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 22/64] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:54.816049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:54.816752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:54.824300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.826185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.826687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:54.827934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:54.828599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:54.829055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.258536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:55.259254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:55.270804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.271938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.273315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.276390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.277039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.277641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.459536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:55.475602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6967de92-375f-4e10-ace6-0a4dd8b0d1d4 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1267 microversion: 2.1 time: 0.221461 Sep 13 14:12:55.491435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 23/65] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:55 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:55.497825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:55.518348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:55.520551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:55.523616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bf0bc61-27a9-4d22-8f6f-f962fb78010d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.712174 Sep 13 14:12:55.524456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 43/66] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:55.540183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:55.542939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:55.560191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.560684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.561116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.561844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.563309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.563741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.614734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:55.615310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:55.624779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.625431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.625897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.632189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.634671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.635265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.929948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:55.942529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4eca2321-cb62-4091-9def-447fa24cdceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1300 microversion: 2.1 time: 0.410876 Sep 13 14:12:55.943338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 24/67] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1300 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:55.962873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:55.963953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:55.969985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.970660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.972087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:55.974118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:55.974913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:55.975554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:56.231613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:56.252578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19375fd2-40ea-489e-89c8-49e001c652c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.638052 Sep 13 14:12:56.253241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 44/68] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:55 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:56.465776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:56.481022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a27375d-bdfc-42aa-a02f-1688f83d70e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.534327 Sep 13 14:12:56.481994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 25/69] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:56.525995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:56.529421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:56.558406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:56.559101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:56.578175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:56.581848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:56.586489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:56.588115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:56.600332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:56.605117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:56.606867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:56.608283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:56.608703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:56.610409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:56.613987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:56.615730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:56.833878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:56.843500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ba29512-7c5d-4131-afd4-95242932d5b7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1273 microversion: 2.1 time: 0.339207 Sep 13 14:12:56.849381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 45/70] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:56 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:56.980272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4aa450cb-7249-417f-b517-8356f0453a02 req-cb0f658d-4f24-4f6f-85cb-00ac0ea59c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1791b49a-ae8a-4b9d-a575-dc20ba423604", "name": "network-vif-plugged", "status": "completed", "tag": "a9685535-ba6f-4ba1-9ad0-05089e69c294"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:56.993215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4aa450cb-7249-417f-b517-8356f0453a02 req-cb0f658d-4f24-4f6f-85cb-00ac0ea59c8c service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:56.993882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4aa450cb-7249-417f-b517-8356f0453a02 req-cb0f658d-4f24-4f6f-85cb-00ac0ea59c8c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:56.995160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4aa450cb-7249-417f-b517-8356f0453a02 req-cb0f658d-4f24-4f6f-85cb-00ac0ea59c8c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.034214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4aa450cb-7249-417f-b517-8356f0453a02 req-cb0f658d-4f24-4f6f-85cb-00ac0ea59c8c service nova] Creating event network-vif-plugged:a9685535-ba6f-4ba1-9ad0-05089e69c294 for instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 on hv-cinder-85743 Sep 13 14:12:57.049437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4aa450cb-7249-417f-b517-8356f0453a02 req-cb0f658d-4f24-4f6f-85cb-00ac0ea59c8c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198018 Sep 13 14:12:57.050648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 46/71] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:57.070393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:57.076605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:57.078548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:57.080544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:57.087579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:57.088979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88acbcdc-5a9b-4cfd-8289-0b60f143b826 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.541633 Sep 13 14:12:57.104186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.106239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.106954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 26/72] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:12:57.108042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.109329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.110082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.111328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.241245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:57.249117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76c57572-64ce-4629-a5b1-419b6040916f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1300 microversion: 2.1 time: 0.196178 Sep 13 14:12:57.264365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 47/73] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:57.277190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:57.277878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:57.290510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.290998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.294504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.299427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.302307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.303093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.510627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:57.512122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:57.524354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.524859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.525296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.526021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.526475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.526895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.655851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:57.668311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ffbd07b-7a7a-499a-a61a-fdfcdb0f9174 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.395360 Sep 13 14:12:57.668896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 27/74] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:57 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:12:57.876962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:57.877672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:57.887533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.892043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.892612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.894115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:57.901093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:57.901912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:57.979384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:57.988584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff19583a-c4b2-4b78-9816-3e55f6c62523 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.482104 Sep 13 14:12:57.989222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 48/75] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:58.116348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:58.117302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:58.133007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:58.133799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:58.134395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:58.135986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:58.136599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:58.137179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:58.474257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:58.483515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b8063f3b-94e1-4af7-ad6f-c4c507ac39a2 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.611223 Sep 13 14:12:58.487796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 28/76] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:57 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:12:58.496994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:58.497622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:58.512913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:58.514048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:58.514674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:58.516216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:58.516955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:58.517707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:58.527679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:58.552123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:58.554026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:58.558282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a813671b-bc86-4e60-ae56-91cf04ee6ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.448122 Sep 13 14:12:58.559171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 49/77] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:12:58.696211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:58.697239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:58.706718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:58.707986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:58.708653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:58.709594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:58.713684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:58.714709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:58.928370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:58.938634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82127d29-f1c7-47bd-8224-f4e7e154f535 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.448150 Sep 13 14:12:58.942278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 29/78] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:59.042646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:59.049499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:59.059167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.060202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.061810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.062760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.063429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.064062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.070491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:59.146014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:59.158954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa2605b2-cb53-4e41-9e0d-58f969a8e6f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.468844 Sep 13 14:12:59.159620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 50/79] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:58 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:12:59.307486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:59.317033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1c004932-9443-4f61-9955-54c9ee652895 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.308685 Sep 13 14:12:59.330066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 30/80] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:59.452499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ed8ead72-331c-4016-88ff-db60674dc3a5 req-ed80029f-19e4-4748-87b9-2f0b8e536699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a135d16e-8e8e-4582-ac03-366876df7369", "tag": "bc5cdfa1-9e5a-4662-91f9-047e110b433b"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:59.470022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ed8ead72-331c-4016-88ff-db60674dc3a5 req-ed80029f-19e4-4748-87b9-2f0b8e536699 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.470490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ed8ead72-331c-4016-88ff-db60674dc3a5 req-ed80029f-19e4-4748-87b9-2f0b8e536699 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.470920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ed8ead72-331c-4016-88ff-db60674dc3a5 req-ed80029f-19e4-4748-87b9-2f0b8e536699 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.511262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:59.511880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:59.537557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.540145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ed8ead72-331c-4016-88ff-db60674dc3a5 req-ed80029f-19e4-4748-87b9-2f0b8e536699 service nova] Creating event network-changed:bc5cdfa1-9e5a-4662-91f9-047e110b433b for instance a135d16e-8e8e-4582-ac03-366876df7369 on hv-cinder-85743 Sep 13 14:12:59.541388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.542078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.542980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.545309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.546060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.555804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ed8ead72-331c-4016-88ff-db60674dc3a5 req-ed80029f-19e4-4748-87b9-2f0b8e536699 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107418 Sep 13 14:12:59.557552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 51/81] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:12:59.588359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:59.589326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:59.597404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.598899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.599822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.601013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.601755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.602995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.610437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:12:59.756494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:59.768304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-04422012-0754-43af-8abf-dd2d3626a946 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.261195 Sep 13 14:12:59.770697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 31/82] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:59 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:12:59.866841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-4038ae9c-71f4-44c1-903a-79ce6c4d3aa5 req-c5348fcd-936e-4a05-a249-d4955c4990da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ef5516-80d3-4bec-a520-59afd1fba3e6", "tag": "47dadccd-411d-4f62-9c59-ed6e80c2a2c5"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:12:59.876694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4038ae9c-71f4-44c1-903a-79ce6c4d3aa5 req-c5348fcd-936e-4a05-a249-d4955c4990da service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.877322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4038ae9c-71f4-44c1-903a-79ce6c4d3aa5 req-c5348fcd-936e-4a05-a249-d4955c4990da service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.877888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4038ae9c-71f4-44c1-903a-79ce6c4d3aa5 req-c5348fcd-936e-4a05-a249-d4955c4990da service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.891106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-4038ae9c-71f4-44c1-903a-79ce6c4d3aa5 req-c5348fcd-936e-4a05-a249-d4955c4990da service nova] Creating event network-changed:47dadccd-411d-4f62-9c59-ed6e80c2a2c5 for instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 on hv-cinder-85743 Sep 13 14:12:59.897393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-4038ae9c-71f4-44c1-903a-79ce6c4d3aa5 req-c5348fcd-936e-4a05-a249-d4955c4990da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035013 Sep 13 14:12:59.898059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 32/83] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:12:59.960594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:59.967233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:12:59.968509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:12:59.974846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:59.978022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.979289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.979757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.981154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:12:59.981971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:12:59.982830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:12:59.983817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:12:59.986339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b54d69e-28a6-4425-b7a2-ea79cb5c67c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.402154 Sep 13 14:12:59.990199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 52/84] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:12:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:13:00.187643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:00.190176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:00.201903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.215325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.217378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.218412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.220485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.221165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.392657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:00.406126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-181a8dca-eed9-4f9d-8083-e378707255d7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.445628 Sep 13 14:13:00.406711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 33/85] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:12:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:00.419907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:00.429795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:00.450348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.453204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.458141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.461092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.462039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.463230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.759693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:00.781282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:00.791930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3364a392-5303-4227-8d6b-e9404b885a50 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.610005 Sep 13 14:13:00.798663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 53/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:00 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:00.822625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-0895c65b-57ba-4226-97cf-da8f9890f2e3 req-c4e68272-1758-4c93-a91e-c13c16f77a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92521eb-7555-438a-9c2c-463107546a43", "name": "network-vif-plugged", "status": "completed", "tag": "e5c55372-27ef-4a81-9b64-fe1b11dc0ef0"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:00.842406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:00.844564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0895c65b-57ba-4226-97cf-da8f9890f2e3 req-c4e68272-1758-4c93-a91e-c13c16f77a51 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.845249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0895c65b-57ba-4226-97cf-da8f9890f2e3 req-c4e68272-1758-4c93-a91e-c13c16f77a51 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.845900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0895c65b-57ba-4226-97cf-da8f9890f2e3 req-c4e68272-1758-4c93-a91e-c13c16f77a51 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.883902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-0895c65b-57ba-4226-97cf-da8f9890f2e3 req-c4e68272-1758-4c93-a91e-c13c16f77a51 service nova] Creating event network-vif-plugged:e5c55372-27ef-4a81-9b64-fe1b11dc0ef0 for instance c92521eb-7555-438a-9c2c-463107546a43 on hv-cinder-85743 Sep 13 14:13:00.902247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-0895c65b-57ba-4226-97cf-da8f9890f2e3 req-c4e68272-1758-4c93-a91e-c13c16f77a51 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101156 Sep 13 14:13:00.912926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 54/87] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:00.918480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:00.919171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:00.955139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.960948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.961396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.962589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:00.970239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:00.970806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:00.975816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:00.996634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d90fc914-c7c4-4c56-b5af-23dd35f81415 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.579416 Sep 13 14:13:00.999513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 34/88] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:01.023638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:01.034349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:01.044654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:01.045430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:01.046142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:01.047065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:01.047721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:01.048415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:01.330626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:01.662091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:01.670163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-429bfde9-a43c-4e11-8759-fc0ab59ac99e tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.755757 Sep 13 14:13:01.670741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 55/89] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:00 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:01.675242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:01.675940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:01.689146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:01.689639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:01.692813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:01.693541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:01.694070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:01.694459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:01.702718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:01.726223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:01.727788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:01.728914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0333350c-165b-484d-82a0-831faafe1e85 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.710905 Sep 13 14:13:01.729639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 35/90] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:13:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:13:01.815433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:01.815972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:01.834063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:01.834963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:01.835744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:01.836525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:01.837157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:01.837643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:01.881618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:01.889360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e5c9c16-3549-4b89-8320-09bfa91b737f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.217566 Sep 13 14:13:01.890488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 56/91] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:02.024451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:02.025199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:02.037908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:02.041670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.042546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.043184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.043907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.044513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.045024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.048920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a620b314-fd80-4039-9ac6-2073c77c672f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.237854 Sep 13 14:13:02.053834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 36/92] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:01 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:02.218815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:02.229684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd74ad55-587f-47ab-bdd6-a2deb153da49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.209289 Sep 13 14:13:02.237793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 57/93] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:02.693422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:02.694807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:02.701530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.702053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.702493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.703203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.703664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.704093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.756871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:02.757604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:02.764070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.764812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.765513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.766437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.767101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.767719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.876514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:02.884390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5851eb12-1052-4b0b-9879-50c94066cbee tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.196031 Sep 13 14:13:02.885209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 37/94] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:02 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:02.915370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:02.915978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:02.922149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.922821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.923705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.924416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:02.925134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:02.925318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:02.962960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:02.972148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:02.973609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:02.974905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eaa517f2-d5e5-40c4-87e8-adbbfce3acbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.222369 Sep 13 14:13:02.975884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 58/95] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:13:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:13:02.982740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c77e04fe-3528-40f8-8efb-515a6abe4a83", "name": "network-vif-plugged", "status": "completed", "tag": "7edcac2b-89f0-4449-b10d-3e2dbafe596d"}, {"server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "name": "network-vif-plugged", "status": "completed", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:03.001122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.001868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.002335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.018829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] Creating event network-vif-plugged:7edcac2b-89f0-4449-b10d-3e2dbafe596d for instance c77e04fe-3528-40f8-8efb-515a6abe4a83 on hv-cinder-85743 Sep 13 14:13:03.019404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] Creating event network-vif-plugged:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:13:03.027646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b87024bb-c88e-4fd9-90b6-bad7795589fd req-d4d42eb4-7d8c-4fc3-818a-bf2f72e9b3ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049884 Sep 13 14:13:03.028320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 59/96] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:03.070615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:03.074858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:03.075570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:03.078967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a52b4797-4dcf-4a93-a84b-72392baa0f1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.168585 Sep 13 14:13:03.082020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.082547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.083220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.083933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.084390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.084816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.096393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 38/97] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:03.255839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:03.256626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:03.267516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.268560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.270218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.271212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.284948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.286549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.417599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:03.432372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec054939-d0ef-4ce7-a75e-960b52e002b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1321 microversion: 2.1 time: 0.362690 Sep 13 14:13:03.433811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 60/98] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:03 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1321 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:03.448319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:03.565134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1253341557", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:03.634482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:03.641892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] validate_networks() for None {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:13:03.642849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-96778de6-dcb3-4ff0-9b9f-25f0652a0daa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.392598 Sep 13 14:13:03.643417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 39/99] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:03.908813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:03.909699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:03.916843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.917394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.917934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.918646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.919112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.919594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.948901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:13:03.949325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:13:03.949815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:13:03.950218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:13:03.950625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:13:03.960137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.960623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.961046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.961908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:03.962365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:03.962783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:03.979854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Getting quotas for project 24c3882ed5ac499f9aba5de4d43bf336. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:13:03.984106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Getting quotas for user 606e27c7d61546e1b546bab7109157fd and project 24c3882ed5ac499f9aba5de4d43bf336. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:13:03.998312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:13:04.000744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:13:04.064699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-591bb722-3450-442c-a876-3100906187a3 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503378 Sep 13 14:13:04.065349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 61/100] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 14:13:04.070231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:04.070826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:04.080326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.080465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.081699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.083715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.084589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.085375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.086031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.100047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-51d6ea04-9a57-4d7d-b9df-a95dfc678d6c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.195803 Sep 13 14:13:04.120575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 40/101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:03 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:04.126925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c5755e81-4ad1-4f5f-9e6d-8a1eda029e74 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:04.143393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c5755e81-4ad1-4f5f-9e6d-8a1eda029e74 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:04.243709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c5755e81-4ad1-4f5f-9e6d-8a1eda029e74 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.252390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c5755e81-4ad1-4f5f-9e6d-8a1eda029e74 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1215 microversion: 2.1 time: 0.130706 Sep 13 14:13:04.252958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 41/102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:04 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:04.271528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:04.272187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:04.278193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.279013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.279599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.280472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.281303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.282026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.339775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.351071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.352907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.354377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d4089b5-232b-4029-9e8b-486bfdb66cfa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.287892 Sep 13 14:13:04.355690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 62/103] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:13:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:13:04.463865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:04.464583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:04.474735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.477457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.478205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.479816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.480280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.480702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.502327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.523138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8351ceb5-2045-4a80-aa5a-dece58dcea5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.267755 Sep 13 14:13:04.524028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 42/104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:04.669043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.670531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:04.671626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:04.681323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.682660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.684049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.685024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.685713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.686582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.701678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4869b4da-da5a-47be-b311-9595073b7e94 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1515 microversion: 2.1 time: 0.239895 Sep 13 14:13:04.714312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 63/105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:04 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:04.763618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:04.771119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:04.787502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.788102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.788606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.789333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:04.789816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:04.790243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:04.878591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lazy-loading 'flavor' on Instance uuid c92521eb-7555-438a-9c2c-463107546a43 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:13:04.902093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:04.914265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8655a30-611e-4cc3-8f91-80dbef769f2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.249588 Sep 13 14:13:04.915655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 43/106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:05.021155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8304edb-e4ed-4809-be5b-94cb56a894c7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43/action" status: 200 len: 32 microversion: 2.1 time: 0.264465 Sep 13 14:13:05.022165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 64/107] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:13:04 2022] POST /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 14:13:05.031984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:05.032589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:05.038831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.039321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.039842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.040541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.041030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.041462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.128652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:05.130379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:05.138330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.139128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.142961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.143702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.144164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.144583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.186655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.194572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6662f1df-f063-422f-9e2f-609131ae6bee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.166468 Sep 13 14:13:05.195138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 44/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:05 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:05.275562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:05.276116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:05.282052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.282534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.282961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.283640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.284312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.284732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.343861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.348405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.352971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2714c2f6-f106-4d63-a009-2b947abc2ee6 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.228577 Sep 13 14:13:05.353888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 65/109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:05 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:05.357131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9c49bc73-4ab3-448d-9279-7401dd60c983 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1219 microversion: 2.1 time: 0.085262 Sep 13 14:13:05.357533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 45/110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:05 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:05.380236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:05.380833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:05.386684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.387163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.387589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.388267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.388716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.389151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.513599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.523593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.525071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.526262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e460a530-31c2-4fbb-8bd9-ccb532c283b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.149869 Sep 13 14:13:05.527442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 66/111] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:13:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:13:05.547352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:05.548132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:05.554338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.554840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.555276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.555965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.556421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.556870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.713021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:05.727904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21fde677-ea9f-43ad-b3d7-2026e68fbd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.184328 Sep 13 14:13:05.728621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 46/112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:05.940452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:05.941054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:05.947791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.948369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.948864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:05.949561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:05.950035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:05.950456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.091512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.127635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cecbef4a-5792-4ff1-8fbd-58dd96123636 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1363 microversion: 2.1 time: 0.191437 Sep 13 14:13:06.128971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 67/113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:06.217293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:06.218773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:06.227153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.227840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.228277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.228977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.230019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.230454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.377265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:06.377910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:06.388039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.388531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.389148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.389694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.389879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.390552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.390968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.399391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd5fff81-d4cd-4a1a-aa6d-da4d50b0118e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.186309 Sep 13 14:13:06.409761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 47/114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:06 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:06.409761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:06.409761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:06.414298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.414912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.415358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.416148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.416647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.417112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.438885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:06.491769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.499766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-282f881e-06dd-4d2a-bb6f-d6d267369f66 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1267 microversion: 2.1 time: 0.098377 Sep 13 14:13:06.500347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 48/115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:06 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:06.505430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-5d032729-7002-4031-bd3c-df97f9d71b4b req-8dde06bc-9b22-4c83-8ed1-10d798152b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a135d16e-8e8e-4582-ac03-366876df7369", "name": "network-vif-plugged", "status": "completed", "tag": "bc5cdfa1-9e5a-4662-91f9-047e110b433b"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:06.515210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-5d032729-7002-4031-bd3c-df97f9d71b4b req-8dde06bc-9b22-4c83-8ed1-10d798152b65 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.516063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-5d032729-7002-4031-bd3c-df97f9d71b4b req-8dde06bc-9b22-4c83-8ed1-10d798152b65 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.516651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-5d032729-7002-4031-bd3c-df97f9d71b4b req-8dde06bc-9b22-4c83-8ed1-10d798152b65 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.538674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-5d032729-7002-4031-bd3c-df97f9d71b4b req-8dde06bc-9b22-4c83-8ed1-10d798152b65 service nova] Creating event network-vif-plugged:bc5cdfa1-9e5a-4662-91f9-047e110b433b for instance a135d16e-8e8e-4582-ac03-366876df7369 on hv-cinder-85743 Sep 13 14:13:06.545915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-5d032729-7002-4031-bd3c-df97f9d71b4b req-8dde06bc-9b22-4c83-8ed1-10d798152b65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044368 Sep 13 14:13:06.546519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 49/116] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:06.554101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:06.555599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:06.562643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.563395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.564176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.564883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.565347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.566141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.570431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.573859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:06.579452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3d0e62d-b13c-490e-acd3-ca815e0c9527 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.206767 Sep 13 14:13:06.580170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 68/117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:06 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:06.713810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.721862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.723996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.725090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e95105c-0f5e-4014-9981-334c2e5784e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1406 microversion: 2.20 time: 0.176502 Sep 13 14:13:06.725647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 50/118] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:13:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:13:06.752158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:06.752761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:06.759777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.760608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.761037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.761934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:06.762432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:06.762852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:06.950816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:06.962437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fe40ca9-0254-49da-a418-3ad68ed0921d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 0.211987 Sep 13 14:13:06.963794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 69/119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:07.156506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.157178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.163885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.164380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.164808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.165539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.166020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.166443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.305424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:07.313993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e74966a2-f133-42ce-ab6e-11e25b82af59 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1549 microversion: 2.1 time: 0.161346 Sep 13 14:13:07.314857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 51/120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:07.340990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.341659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.348292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.348788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.349234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.349984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.350446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.350879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.427193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.427828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.434666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.435420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.436175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.436925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.437605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.438593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.614339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:07.623014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-117e20c0-9ba8-4a07-8d8d-e7753921b62e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.200606 Sep 13 14:13:07.623614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 52/121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:07.645472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.646732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.654762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.655299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.655835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.656657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.657207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.657798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.716106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7286397c-85b3-48ca-92ec-0e8fec179141 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.379022 Sep 13 14:13:07.717711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 70/122] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:07.722711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.723446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.734456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.735231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.735757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.736553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.737223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.738610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.758181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:07.767560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05701d92-1eef-45bc-8fe3-3bd284232a43 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1267 microversion: 2.1 time: 0.129249 Sep 13 14:13:07.768134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 53/123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:07.773617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.774245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.777183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:07.780690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.781176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.781610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.782329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.782779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.783205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.915736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:07.923838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:07.925291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:07.926982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d40d0f73-4182-4051-8770-9adfe1a7dbe3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1599 microversion: 2.20 time: 0.157764 Sep 13 14:13:07.927547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 54/124] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:13:07.956692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:07.957226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:07.963940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.964591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.965209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:07.965938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:07.966393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:07.966815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:08.194495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:08.208630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3a2605e-bcd4-4c98-bc04-7c9fb1834db1 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.487863 Sep 13 14:13:08.209596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 71/125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:08.240199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a33ab765-5969-4904-b790-4f90a0fbf15b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.287667 Sep 13 14:13:08.254276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 55/126] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 13 14:13:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-interface => generated 285 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:13:08.264811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:08.266258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:08.274390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:08.295168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:08.295763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:08.296213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:08.296950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:08.302425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:08.304360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:08.564015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-8098c3b3-7ffe-4742-bd00-928418857785 req-749205c7-206e-446a-8015-bbc842d358aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ef5516-80d3-4bec-a520-59afd1fba3e6", "name": "network-vif-plugged", "status": "completed", "tag": "47dadccd-411d-4f62-9c59-ed6e80c2a2c5"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:08.584648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-8098c3b3-7ffe-4742-bd00-928418857785 req-749205c7-206e-446a-8015-bbc842d358aa service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:08.585184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-8098c3b3-7ffe-4742-bd00-928418857785 req-749205c7-206e-446a-8015-bbc842d358aa service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:08.586775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-8098c3b3-7ffe-4742-bd00-928418857785 req-749205c7-206e-446a-8015-bbc842d358aa service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:08.607172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-8098c3b3-7ffe-4742-bd00-928418857785 req-749205c7-206e-446a-8015-bbc842d358aa service nova] Creating event network-vif-plugged:47dadccd-411d-4f62-9c59-ed6e80c2a2c5 for instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 on hv-cinder-85743 Sep 13 14:13:08.612907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-8098c3b3-7ffe-4742-bd00-928418857785 req-749205c7-206e-446a-8015-bbc842d358aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052989 Sep 13 14:13:08.614612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 56/127] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:13:08.666667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:08.668322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:08.679544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:08.680036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:08.680468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:08.681369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:08.681860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:08.682301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:08.984894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:09.008146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3341d365-2783-48c7-9762-a92c3d532762 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.346663 Sep 13 14:13:09.022327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 57/128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:08 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:09.033568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:09.036276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:09.053608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:09.054494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:09.055156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:09.057474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:09.058020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:09.060467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:09.171819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:09.187499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9ca77f17-4664-4709-a1cc-25bd99c8f34d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1273 microversion: 2.1 time: 0.163987 Sep 13 14:13:09.188346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 58/129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:09 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:09.237238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:09.239365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:09.246269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:09.246993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:09.248058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:09.248196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:09.248753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:09.249185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:09.249416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:09.257821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac371ae1-db48-43af-8a1b-a9d0c9c904b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1366 microversion: 2.1 time: 1.032802 Sep 13 14:13:09.261168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 72/130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1366 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:09.455031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:09.464240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-73668b53-3391-454c-8671-c1f3f3676796 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.231715 Sep 13 14:13:09.464732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 59/131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:09 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:10.037706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:10.038690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:10.052471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.053320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.053966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.056995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.058668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.059356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.213716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:10.215239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:10.228257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.228810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.229344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.230186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.230778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.231301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.462613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:10.469926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:10.483450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a012c224-98ba-4e9b-bd60-569ac48761db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.451082 Sep 13 14:13:10.485097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 73/132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:10 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:10.489569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:10.490493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:10.499113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ab300eed-2c53-4ea6-913b-3d72636988a4 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.288673 Sep 13 14:13:10.501377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 60/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:10 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:10.504340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.504822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.505255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.506202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.506815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.507387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.514356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:10.515501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:10.526094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.528368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.529096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.530312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.531814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.532501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.793133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:10.803535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-85a775bb-3ec9-4fe4-a1c7-0b05cba2e3b0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.300569 Sep 13 14:13:10.805209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 61/134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:10 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:10.810091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-873e3925-b950-4fb3-a3c5-0d6d8389c353 req-ba1d249c-6aff-4d60-a2fd-1b575c294481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1", "tag": "352cf0aa-5b47-4c9e-a533-abe3497ec855"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:10.822458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-873e3925-b950-4fb3-a3c5-0d6d8389c353 req-ba1d249c-6aff-4d60-a2fd-1b575c294481 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.823455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-873e3925-b950-4fb3-a3c5-0d6d8389c353 req-ba1d249c-6aff-4d60-a2fd-1b575c294481 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.824186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-873e3925-b950-4fb3-a3c5-0d6d8389c353 req-ba1d249c-6aff-4d60-a2fd-1b575c294481 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.845780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-873e3925-b950-4fb3-a3c5-0d6d8389c353 req-ba1d249c-6aff-4d60-a2fd-1b575c294481 service nova] Creating event network-changed:352cf0aa-5b47-4c9e-a533-abe3497ec855 for instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 on hv-cinder-85743 Sep 13 14:13:10.852167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:10.861975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-873e3925-b950-4fb3-a3c5-0d6d8389c353 req-ba1d249c-6aff-4d60-a2fd-1b575c294481 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054065 Sep 13 14:13:10.863987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cbb8e3e-2113-4c36-83a9-363247b15d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1555 microversion: 2.1 time: 0.378065 Sep 13 14:13:10.864744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 74/135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1555 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:10.869905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 62/136] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:10.887945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-45d03c59-87f9-4505-aa34-d2bc9204310f req-f660167b-383c-48ac-95fb-74e9350bb052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c77e04fe-3528-40f8-8efb-515a6abe4a83", "tag": "7edcac2b-89f0-4449-b10d-3e2dbafe596d"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:10.891542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:10.892447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:10.905659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.908751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.911649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.912246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-45d03c59-87f9-4505-aa34-d2bc9204310f req-f660167b-383c-48ac-95fb-74e9350bb052 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.912633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:10.912749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-45d03c59-87f9-4505-aa34-d2bc9204310f req-f660167b-383c-48ac-95fb-74e9350bb052 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.913174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-45d03c59-87f9-4505-aa34-d2bc9204310f req-f660167b-383c-48ac-95fb-74e9350bb052 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.913391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:10.913925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:10.927077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-45d03c59-87f9-4505-aa34-d2bc9204310f req-f660167b-383c-48ac-95fb-74e9350bb052 service nova] Creating event network-changed:7edcac2b-89f0-4449-b10d-3e2dbafe596d for instance c77e04fe-3528-40f8-8efb-515a6abe4a83 on hv-cinder-85743 Sep 13 14:13:10.933320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-45d03c59-87f9-4505-aa34-d2bc9204310f req-f660167b-383c-48ac-95fb-74e9350bb052 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053816 Sep 13 14:13:10.934658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 75/137] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:11.088717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c9df3ade-c96d-45e1-ba98-ad437af90d72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202131 Sep 13 14:13:11.089615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 63/138] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:13:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:13:11.507652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:11.508505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:11.524281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:11.525048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:11.525637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:11.526478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:11.527195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:11.527486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:11.528081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:11.528665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:11.538895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:11.541239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:11.545043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:11.546111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:11.546798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:11.547489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:11.826123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:11.842487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a86911ef-3bbe-48e5-a260-624782567527 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.339575 Sep 13 14:13:11.844876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 76/139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:11 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:11.862592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:11.865011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:11.866489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:11.873479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e1dcc49e-8c33-46d0-9352-d393e7c4b83f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.351829 Sep 13 14:13:11.879892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:11.881006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:11.881763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 64/140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:11 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:11.882322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:11.883950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:11.885172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:11.886295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:12.640929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:12.663210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8649b409-82dc-49fa-81b9-e24fcdba49db tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1315 microversion: 2.1 time: 0.815898 Sep 13 14:13:12.670974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 77/141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:11 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:12.868608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:12.869699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:12.881652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:12.882504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:12.883053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:12.885753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:12.886470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:12.887139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:12.907725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:12.908511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:12.919755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:12.930156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:12.931675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:12.933458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:12.934982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:12.936346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:13.337921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:13.346058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0807cdc5-f2e1-4cbc-a5c1-219df8c86943 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.442028 Sep 13 14:13:13.346657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 78/142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:12 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:13.354685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-293a7855-85f9-41b7-bf70-1e614d8b3c86 req-ceabf12d-c0f2-4154-b35c-b7a96c1e0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:13.379665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-293a7855-85f9-41b7-bf70-1e614d8b3c86 req-ceabf12d-c0f2-4154-b35c-b7a96c1e0b9f service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:13.387566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-293a7855-85f9-41b7-bf70-1e614d8b3c86 req-ceabf12d-c0f2-4154-b35c-b7a96c1e0b9f service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:13.392538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-293a7855-85f9-41b7-bf70-1e614d8b3c86 req-ceabf12d-c0f2-4154-b35c-b7a96c1e0b9f service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:13.412780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-293a7855-85f9-41b7-bf70-1e614d8b3c86 req-ceabf12d-c0f2-4154-b35c-b7a96c1e0b9f service nova] Creating event network-changed:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:13:13.419411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-293a7855-85f9-41b7-bf70-1e614d8b3c86 req-ceabf12d-c0f2-4154-b35c-b7a96c1e0b9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067983 Sep 13 14:13:13.421176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 79/143] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:13.698881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:13.700327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:13.713171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:13.716818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:13.717508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:13.718262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:13.718899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:13.720124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:13.757500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:13.767334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad9c4752-b99c-480c-9a88-35bb95bf9821 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.902633 Sep 13 14:13:13.767899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 65/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:12 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:13.973809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:13.997350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:14.183167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:14.196137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70c0b094-e69e-4673-91a2-8dcdbea006dc tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1501 microversion: 2.1 time: 0.501924 Sep 13 14:13:14.197322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 80/145] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:13 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1501 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:14.340919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-7f2c5f33-b4a0-494c-80f2-26c06fc58bbd req-31011493-9a5c-4703-a0b5-85df206d7db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a135d16e-8e8e-4582-ac03-366876df7369", "tag": "bc5cdfa1-9e5a-4662-91f9-047e110b433b"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:14.347790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:14.360702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7f2c5f33-b4a0-494c-80f2-26c06fc58bbd req-31011493-9a5c-4703-a0b5-85df206d7db6 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:14.361544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7f2c5f33-b4a0-494c-80f2-26c06fc58bbd req-31011493-9a5c-4703-a0b5-85df206d7db6 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:14.362401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7f2c5f33-b4a0-494c-80f2-26c06fc58bbd req-31011493-9a5c-4703-a0b5-85df206d7db6 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:14.377972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:14.379302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:14.379665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-7f2c5f33-b4a0-494c-80f2-26c06fc58bbd req-31011493-9a5c-4703-a0b5-85df206d7db6 service nova] Creating event network-changed:bc5cdfa1-9e5a-4662-91f9-047e110b433b for instance a135d16e-8e8e-4582-ac03-366876df7369 on hv-cinder-85743 Sep 13 14:13:14.389954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-7f2c5f33-b4a0-494c-80f2-26c06fc58bbd req-31011493-9a5c-4703-a0b5-85df206d7db6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052788 Sep 13 14:13:14.390732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 66/146] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:14.403226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:14.403974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:14.404413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:14.405151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:14.405607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:14.406055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:14.617426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:14.638143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af0ba4e1-4d03-4e01-9fdf-6d7ee528fd93 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.265395 Sep 13 14:13:14.639485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 81/147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:14 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:14.794421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:14.795863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:14.802260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:14.802737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:14.803167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:14.803847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:14.804294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:14.804708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:14.956939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:14.965813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c3232bc7-8700-4ff6-8dea-14132813992a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.176620 Sep 13 14:13:14.966578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 67/148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:14 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:15.665339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:15.665982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:15.672756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:15.673548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:15.674207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:15.675543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:15.676224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:15.676847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:15.818989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd23b76e-3914-4ea7-aa74-468031e93bd4"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:15.821341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:15.830607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:15.831105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:15.831613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:15.832321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:15.832982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:15.833587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:15.856615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:15.861509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:15.866438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-730c111b-36ea-4377-88cb-d4019415b56f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.204931 Sep 13 14:13:15.873469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 82/149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:15 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:15.992875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:15.997858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:16.005586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:16.006108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:16.006717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:16.007669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:16.008262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:16.008887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:16.239710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-27a37758-45c1-428b-a3de-fa1196524718 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "POST /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423101 Sep 13 14:13:16.241596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 68/150] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:13:15 2022] POST /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:13:16.254768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:16.266394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71714edf-e530-4afa-aa22-dcdb51d6b050 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.279552 Sep 13 14:13:16.267610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 83/151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:15 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:16.889420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:16.890154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:16.897030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:16.897448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:16.897923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:16.898614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:16.899062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:16.899482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:17.067653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:17.077036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e8f2fdab-d6c7-42c6-b05b-faba82d0bfd0 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.192250 Sep 13 14:13:17.091749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 69/152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:16 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:17.292321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:17.292951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:17.299373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:17.300067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:17.300601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:17.301296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:17.301766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:17.302195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:17.471515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:17.480641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5b0c195-cbb5-491d-a61c-a5cc537de96b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.192047 Sep 13 14:13:17.481214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 84/153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:17 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:18.104310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:18.105057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:18.112122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:18.112555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:18.113706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:18.114503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:18.114965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:18.115399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:18.277406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:18.299928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-982a5c72-88ec-4f6c-9da9-8b7b0262d682 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.199299 Sep 13 14:13:18.300552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 70/154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:18 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:18.310846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-4d55272f-2d23-46d8-a06a-3ed5093aa355 req-de6dade9-5930-473a-b580-c987a5c60ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1", "name": "network-vif-plugged", "status": "completed", "tag": "352cf0aa-5b47-4c9e-a533-abe3497ec855"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:18.323909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4d55272f-2d23-46d8-a06a-3ed5093aa355 req-de6dade9-5930-473a-b580-c987a5c60ac0 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:18.324767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4d55272f-2d23-46d8-a06a-3ed5093aa355 req-de6dade9-5930-473a-b580-c987a5c60ac0 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:18.325264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-4d55272f-2d23-46d8-a06a-3ed5093aa355 req-de6dade9-5930-473a-b580-c987a5c60ac0 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:18.341078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-4d55272f-2d23-46d8-a06a-3ed5093aa355 req-de6dade9-5930-473a-b580-c987a5c60ac0 service nova] Creating event network-vif-plugged:352cf0aa-5b47-4c9e-a533-abe3497ec855 for instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 on hv-cinder-85743 Sep 13 14:13:18.347051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-4d55272f-2d23-46d8-a06a-3ed5093aa355 req-de6dade9-5930-473a-b580-c987a5c60ac0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040500 Sep 13 14:13:18.348894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 85/155] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:18.505030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:18.505744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:18.511591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:18.512182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:18.512680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:18.513481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:18.514006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:18.514490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:18.712769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:18.721051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed712ac9-cd62-49b5-b50c-c41182a8f1fa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.220747 Sep 13 14:13:18.721625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 71/156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:18 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:19.323247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:19.323865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:19.329994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:19.330475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:19.330906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:19.332108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:19.332581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:19.332982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:19.461282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:19.468909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83313380-0aa3-4501-a6e5-7a7335c5019e tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1315 microversion: 2.1 time: 0.149938 Sep 13 14:13:19.469471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 86/157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:19 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:19.745290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:19.745945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:19.752505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:19.753013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:19.753517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:19.754239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:19.754741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:19.755158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:19.909112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:19.916972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9f5c04f-9555-4818-813e-460103fc48d3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.175662 Sep 13 14:13:19.917542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 72/158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:19 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:20.492051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:20.492659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:20.498549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.499026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.499454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.500162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.500608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.501024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.631661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:20.635205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:20.640381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab9b50ea-a1c3-4321-8606-070a7c42796a tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1464 microversion: 2.1 time: 0.152745 Sep 13 14:13:20.640942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 87/159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:20 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:20.688471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:20.688895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:20.695038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.695520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.695955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.696652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.697124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.697533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.722821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:13:20.810926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65896eb2-1307-46c2-b986-91bf9a89fb25 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 204 len: 0 microversion: 2.1 time: 0.125955 Sep 13 14:13:20.811753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 73/160] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:13:20 2022] DELETE /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:13:20.819545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:20.820160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:20.826210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.826684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.827111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.827787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.828236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.828655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.941480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:20.942220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:20.948118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.948593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.949019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.949738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:20.950191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:20.950602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:20.953974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:20.962507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91d4fa8f-8b7f-4dfd-8558-b70384e0683f tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1470 microversion: 2.1 time: 0.146813 Sep 13 14:13:20.965811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 88/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:20 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:21.146629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:21.158279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54514fdd-59f0-4cc8-a1bd-37eb03959727 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.221563 Sep 13 14:13:21.167739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 74/162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:20 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:21.985834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:21.986444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:21.992451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:21.993023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:21.993469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:21.994195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:21.994653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:21.995072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:22.154239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:22.162363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be32b728-d337-4b43-9269-b2bab0512a26 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1470 microversion: 2.1 time: 0.180310 Sep 13 14:13:22.162935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 89/163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:21 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:22.183833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:22.184411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:22.191890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:22.192497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:22.193244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:22.194215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:22.194820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:22.195315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:22.325482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:22.333350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e435029-b610-4df6-a6a8-ba63347c1c0b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.154881 Sep 13 14:13:22.333947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 75/164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:22 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:23.188134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:23.188796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:23.195468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:23.196043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:23.196505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:23.197195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:23.197671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:23.198117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:23.334830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:23.342671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f98cbe3-a86c-47bc-b78a-10f417b13786 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1470 microversion: 2.1 time: 0.158366 Sep 13 14:13:23.343229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 90/165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:23 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:23.356157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:23.357415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:23.364675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:23.365169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:23.365604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:23.366327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:23.366782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:23.367254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:23.504077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:23.512752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ea64250-ac92-4f3e-a55c-5106b6f54243 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.160291 Sep 13 14:13:23.513322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 76/166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:23 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:24.367240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:24.367884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:24.374083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:24.374568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:24.375001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:24.375754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:24.376208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:24.376634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:24.538891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:24.541010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:24.548528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:24.551014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:24.551568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:24.552234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:24.554054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:24.554683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:24.555246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:24.556962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2d8ee68-c023-4ae5-bf74-ad957e6e7c08 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1470 microversion: 2.1 time: 0.193881 Sep 13 14:13:24.557543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 91/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:24 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:24.697117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:24.705248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e187468c-9719-4212-ad52-a69c555be70b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.171762 Sep 13 14:13:24.705863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 77/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:24 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:25.587971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:25.589087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:25.607726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:25.608613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:25.609303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:25.610462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:25.611601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:25.613688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:25.732840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:25.735304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:25.743697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:25.744179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:25.744809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:25.745634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:25.746149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:25.746717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:25.820883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:25.830161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0990f332-cfc5-4c75-9ba7-57e431d24ac1 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1470 microversion: 2.1 time: 0.252366 Sep 13 14:13:25.831957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 92/169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:25 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:25.907256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:25.916656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89888545-e039-4956-b65f-f11042732547 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.190590 Sep 13 14:13:25.917218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 78/170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:25 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:26.673988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-f576a836-7a75-4273-b23b-6c3595520c38 req-5ede47a5-fed4-4753-a10a-1a052965035e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1", "name": "network-vif-deleted", "tag": "352cf0aa-5b47-4c9e-a533-abe3497ec855"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:26.684967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f576a836-7a75-4273-b23b-6c3595520c38 req-5ede47a5-fed4-4753-a10a-1a052965035e service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:26.685685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f576a836-7a75-4273-b23b-6c3595520c38 req-5ede47a5-fed4-4753-a10a-1a052965035e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:26.686456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f576a836-7a75-4273-b23b-6c3595520c38 req-5ede47a5-fed4-4753-a10a-1a052965035e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:26.700028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-f576a836-7a75-4273-b23b-6c3595520c38 req-5ede47a5-fed4-4753-a10a-1a052965035e service nova] Creating event network-vif-deleted:352cf0aa-5b47-4c9e-a533-abe3497ec855 for instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 on hv-cinder-85743 Sep 13 14:13:26.705699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-f576a836-7a75-4273-b23b-6c3595520c38 req-5ede47a5-fed4-4753-a10a-1a052965035e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035299 Sep 13 14:13:26.707534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 93/171] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:26.853948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:26.854611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:26.861205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:26.861802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:26.862840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:26.863665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:26.864251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:26.864836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:26.901748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:26.902343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:26.902855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:26.903445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lazy-loading 'fault' on Instance uuid b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:13:26.941594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:26.942333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:26.952715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:26.953126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:26.953563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:26.954304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:26.954772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:26.955203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:27.004239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:27.014666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-563af4e4-0c19-4ca7-b505-e240605d4a0d tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1305 microversion: 2.1 time: 0.164496 Sep 13 14:13:27.015350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 79/172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:26 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1305 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:27.113584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:27.114715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:27.123938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:27.124642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:27.125420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:27.126496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:27.127663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:27.128947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:27.167959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:13:27.169280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:27.178908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-997030a8-5131-4d66-b40a-41c0e6ded0db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.241695 Sep 13 14:13:27.179714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 94/173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:26 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:27.206259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:27.262603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a880a664-281c-40a1-a307-f53da41d3fce tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 204 len: 0 microversion: 2.1 time: 0.153057 Sep 13 14:13:27.263299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 80/174] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:13:27 2022] DELETE /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:13:27.272895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:27.273690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:27.280428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:27.280971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:27.281518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:27.282283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:27.282750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:27.283178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:27.428275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:27.436469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e6686a3-172e-475e-aa98-cef691941027 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1553 microversion: 2.1 time: 0.168390 Sep 13 14:13:27.437234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 95/175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:27 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:28.039642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:28.040462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:28.046990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.047471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.047903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.048583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.049032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.049447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.084639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.084639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.085001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.085545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lazy-loading 'fault' on Instance uuid b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:13:28.127751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:28.136030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f69c6803-1bb8-4e56-9aae-f86d626977cc tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1305 microversion: 2.1 time: 0.100529 Sep 13 14:13:28.136676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 81/176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:28 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:28.205196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:28.207388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:28.213459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.214062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.214675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.215354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.216112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.216765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.420294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:28.429494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b926cd47-bfd2-471f-8bf7-d383cf00a08b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.229169 Sep 13 14:13:28.439398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 96/177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:28 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:28.458531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:28.459142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:28.466817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.467376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.467809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.472834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:28.473306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:28.473889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:28.621101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:28.631517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7fa0b0c6-3522-48ef-a7de-047aa9d3e9ec tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1553 microversion: 2.1 time: 0.176817 Sep 13 14:13:28.632320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 82/178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:28 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:29.160782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:29.161299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:29.167198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.167680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.168116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.168799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.169255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.169682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.201516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.202045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.202633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.203155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lazy-loading 'fault' on Instance uuid b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:13:29.258002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606e27c7d61546e1b546bab7109157fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24c3882ed5ac499f9aba5de4d43bf336', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:29.273380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8561ba94-6bc0-4fa4-872a-c55cc62d6ca2 tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 200 len: 1305 microversion: 2.1 time: 0.116645 Sep 13 14:13:29.285959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 97/179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:29 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 1305 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:29.452326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:29.452933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:29.459998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.460480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.460915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.461602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.462096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.462521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.655327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:29.655945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:29.662429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.662922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.663371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.664081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:29.664539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:29.664967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:29.799087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:29.807980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d24f47e-57ce-4fb6-882a-832d7db9966c tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1553 microversion: 2.1 time: 0.156553 Sep 13 14:13:29.808589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 98/180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:29 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:29.855421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:29.863634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4774a131-f1f1-42df-acf9-bb8fd8c7c257 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.415082 Sep 13 14:13:29.864389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 83/181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:29 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:30.303849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:30.304727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] [instance: b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:30.318734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.319291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.319742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.320471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.323003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.324134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.358444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-07fc2931-3de2-4181-893e-db971578fd5a req-881cdbcd-43f8-4dc8-b78f-daafc31d0a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ef5516-80d3-4bec-a520-59afd1fba3e6", "name": "network-vif-deleted", "tag": "47dadccd-411d-4f62-9c59-ed6e80c2a2c5"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:30.368846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] HTTP exception thrown: Instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 could not be found. Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Request method failure captured: Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 HTTP/1.1 Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_tu8fcUsLbFJP72pRyWUEZWtQVrSY03PlMM5gilhUpwH6yQGeWddAUpZHELU5jVcoy5DaG873GgTi2oQ3o7xdnmdDhfoxJas3kfr9mSFWaxyB3EJBUDseuUmd_z1U1Ijiw7qkSvzWw6rD4lH2A2uhdKd0z0uDUHE64PsqNGZd1ZQY Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 24c3882ed5ac499f9aba5de4d43bf336 Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesNegativeTest-1939184657 Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:13:30.375478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24c3882ed5ac499f9aba5de4d43bf336"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_24c3882ed5ac499f9aba5de4d43bf336"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/24c3882ed5ac499f9aba5de4d43bf336"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/24c3882ed5ac499f9aba5de4d43bf336"}]}] Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesNegativeTest-1939184657 Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 24c3882ed5ac499f9aba5de4d43bf336 Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesNegativeTest-1939184657 Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesNegativeTest-1939184657-project Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 606e27c7d61546e1b546bab7109157fd Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesNegativeTest-1939184657-project Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 could not be found. Sep 13 14:13:30.377090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1'} Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 could not be found. Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:13:30.378561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 could not be found. Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 could not be found. Sep 13 14:13:30.379960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:30.381034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] Returning 404 to user: Instance b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:13:30.381034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92644510-c9f0-4633-bd7f-bb8f8b1488be tempest-VolumesNegativeTest-1939184657 tempest-VolumesNegativeTest-1939184657-project] 10.222.0.20 "GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1" status: 404 len: 111 microversion: 2.1 time: 0.083175 Sep 13 14:13:30.383995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-07fc2931-3de2-4181-893e-db971578fd5a req-881cdbcd-43f8-4dc8-b78f-daafc31d0a50 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.384473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-07fc2931-3de2-4181-893e-db971578fd5a req-881cdbcd-43f8-4dc8-b78f-daafc31d0a50 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.384892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-07fc2931-3de2-4181-893e-db971578fd5a req-881cdbcd-43f8-4dc8-b78f-daafc31d0a50 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.386757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 99/182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:30 2022] GET /compute/v2.1/servers/b856c0d5-a2b3-4944-bb2d-1a1ca79f72a1 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:13:30.405216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-07fc2931-3de2-4181-893e-db971578fd5a req-881cdbcd-43f8-4dc8-b78f-daafc31d0a50 service nova] Creating event network-vif-deleted:47dadccd-411d-4f62-9c59-ed6e80c2a2c5 for instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 on hv-cinder-85743 Sep 13 14:13:30.412698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-07fc2931-3de2-4181-893e-db971578fd5a req-881cdbcd-43f8-4dc8-b78f-daafc31d0a50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057874 Sep 13 14:13:30.413784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 84/183] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:13:30.833116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:30.834112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:30.843435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.844152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.845022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.846354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.847796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.848651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.890487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:30.892370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:30.933551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.934261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.934587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.935363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:30.935946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:30.936242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:30.982447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35dfe8442964bd793276386c2fe6f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a66ebe0eb0ec44fa8fb3ed62d27f9599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:31.004654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e0d59c7-12bc-49f4-bdae-1de9422d6334 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 200 len: 1346 microversion: 2.1 time: 0.176116 Sep 13 14:13:31.005525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 100/184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:30 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 1346 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:31.230828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:31.245267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c899f7a1-86ab-4a4d-b5d1-d22808fe4235 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.359972 Sep 13 14:13:31.257872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 85/185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:30 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:32.033216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:32.033849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:32.039743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:32.040217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:32.040648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:32.041328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:32.041795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:32.042218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:32.055777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] HTTP exception thrown: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Request method failure captured: Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 HTTP/1.1 Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_R7QUkuu1A4Wssm08fliGtU7rt1gAXCS0AdNe-3Vvh8X7pqTM1Z6Paaimw9oZTSiQY1uZNbcT-UvjVzOnabQ1gicP0o36eoS9oruBAIPrtVtoSZGoLPufWRaOQ0byqbw1qFH-8T_JDIwqrsiHac6E07Q4b1nBSC2uyWp7yQ8t_qYE Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:13:32.057307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}] Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: e35dfe8442964bd793276386c2fe6f95 Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.058741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'e4ef5516-80d3-4bec-a520-59afd1fba3e6'} Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:13:32.059543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.060615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.061563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Returning 404 to user: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:13:32.061563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-531532d4-9390-4fca-97f0-e23f07bae4c7 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 404 len: 111 microversion: 2.1 time: 0.029254 Sep 13 14:13:32.061563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 101/186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:32 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:13:32.176546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:32.178706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:32.185105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:32.185582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:32.186051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:32.186742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:32.187193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:32.187614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:32.203198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] HTTP exception thrown: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Request method failure captured: Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6/os-volume_attachments HTTP/1.1 Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_R7QUkuu1A4Wssm08fliGtU7rt1gAXCS0AdNe-3Vvh8X7pqTM1Z6Paaimw9oZTSiQY1uZNbcT-UvjVzOnabQ1gicP0o36eoS9oruBAIPrtVtoSZGoLPufWRaOQ0byqbw1qFH-8T_JDIwqrsiHac6E07Q4b1nBSC2uyWp7yQ8t_qYE Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:13:32.212703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}] Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: e35dfe8442964bd793276386c2fe6f95 Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.214164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'server_id': 'e4ef5516-80d3-4bec-a520-59afd1fba3e6'} Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:13:32.214950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:32.216202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:13:32.217445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Returning 404 to user: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:13:32.217445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4adc9952-60ba-4cf8-8d14-179c613c1306 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041843 Sep 13 14:13:32.217445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 86/187] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:13:32 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:13:32.286912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:32.287549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:32.296732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:32.297226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:32.297660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:32.298415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:32.298871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:32.299292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:32.462214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:32.470411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c1b6337-a887-494a-931f-64b99e78aa9b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.188298 Sep 13 14:13:32.471060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 102/188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:32 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:33.498550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:33.499171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:33.507670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:33.508654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:33.508654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:33.509312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:33.509950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:33.510380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:33.585024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:33.586094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:33.592331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:33.592824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:33.593543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:33.594533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:33.595497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:33.596219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:33.614588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] HTTP exception thrown: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Request method failure captured: Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 HTTP/1.1 Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_R7QUkuu1A4Wssm08fliGtU7rt1gAXCS0AdNe-3Vvh8X7pqTM1Z6Paaimw9oZTSiQY1uZNbcT-UvjVzOnabQ1gicP0o36eoS9oruBAIPrtVtoSZGoLPufWRaOQ0byqbw1qFH-8T_JDIwqrsiHac6E07Q4b1nBSC2uyWp7yQ8t_qYE Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:13:33.616667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}] Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: e35dfe8442964bd793276386c2fe6f95 Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.617943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'e4ef5516-80d3-4bec-a520-59afd1fba3e6'} Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:13:33.618608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.620637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.624649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Returning 404 to user: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:13:33.624649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd6b34f9-60e3-49f7-a352-0d7e4eddf0e0 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 404 len: 111 microversion: 2.1 time: 0.038028 Sep 13 14:13:33.624649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 103/189] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:13:33 2022] DELETE /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 14:13:33.628413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:33.629111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] [instance: e4ef5516-80d3-4bec-a520-59afd1fba3e6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:33.637215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:33.637716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:33.640463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:33.641194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:33.641662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:33.642195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:33.658309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] HTTP exception thrown: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Request method failure captured: Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 HTTP/1.1 Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_R7QUkuu1A4Wssm08fliGtU7rt1gAXCS0AdNe-3Vvh8X7pqTM1Z6Paaimw9oZTSiQY1uZNbcT-UvjVzOnabQ1gicP0o36eoS9oruBAIPrtVtoSZGoLPufWRaOQ0byqbw1qFH-8T_JDIwqrsiHac6E07Q4b1nBSC2uyWp7yQ8t_qYE Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:13:33.661084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a66ebe0eb0ec44fa8fb3ed62d27f9599"}]}] Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: a66ebe0eb0ec44fa8fb3ed62d27f9599 Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-DeleteServersTestJSON-1484734483 Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: e35dfe8442964bd793276386c2fe6f95 Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-DeleteServersTestJSON-1484734483-project Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.662534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'e4ef5516-80d3-4bec-a520-59afd1fba3e6'} Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:13:33.663367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. Sep 13 14:13:33.664574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:13:33.666454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] Returning 404 to user: Instance e4ef5516-80d3-4bec-a520-59afd1fba3e6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:13:33.667347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6460fe2-cc75-4e31-9d06-026529e43222 tempest-DeleteServersTestJSON-1484734483 tempest-DeleteServersTestJSON-1484734483-project] 10.222.0.20 "GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6" status: 404 len: 111 microversion: 2.1 time: 0.043986 Sep 13 14:13:33.671575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 104/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:33 2022] GET /compute/v2.1/servers/e4ef5516-80d3-4bec-a520-59afd1fba3e6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:13:33.679245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:33.687126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d206866e-202f-467d-82a0-e43406772012 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.192471 Sep 13 14:13:33.687688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 87/191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:33 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:34.711326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:34.711937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:34.718483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:34.718991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:34.719457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:34.720215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:34.720684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:34.721163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:34.929680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:34.939079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4f30d87-e67a-4318-918f-904577a9c50b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.231292 Sep 13 14:13:34.939660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 105/192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:34 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:35.963701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:35.964457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:35.974343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:35.978460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:35.980850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:35.982503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:35.983202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:35.984716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:36.170677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:36.179668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c94971a6-71c6-4230-a527-733c35fa61c8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.220623 Sep 13 14:13:36.180631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 88/193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:35 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:37.207794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:37.208538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:37.219023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:37.220402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:37.228177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:37.228947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:37.229429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:37.229898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:37.556281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:37.564596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f861266-b6d3-45f2-9467-463cdb640337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.363994 Sep 13 14:13:37.566134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 106/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:37 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:38.590845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:38.592044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:38.602474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:38.604958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:38.610417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:38.613147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:38.615442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:38.616038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:38.617619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:38.883306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:38.891657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48e32e53-2cd7-4737-95f1-5ac952e163b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.307281 Sep 13 14:13:38.892546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 89/195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:38 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:39.921146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:39.922415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:39.925970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=71 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:39.930234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:39.930819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:39.931328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:39.932100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:39.932633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:39.933123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:39.960071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:40.100517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:40.108526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0770031c-3725-49c9-9743-88e32f888b41 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.191706 Sep 13 14:13:40.109123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 107/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:39 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:40.937363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1535114414", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "networks": [{"uuid": "a7cdf52e-f246-4a80-80f0-1dd76fd51c11"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:41.022513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] validate_networks() for [('a7cdf52e-f246-4a80-80f0-1dd76fd51c11', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:13:41.134167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:41.134774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:41.144063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:41.144562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:41.144962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:41.146155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:41.147447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:41.148181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:41.308349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:41.319040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4736d615-f283-44c7-ae4b-b32535819786 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.190011 Sep 13 14:13:41.319783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 108/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:41 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:41.629404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:13:41.629765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:13:41.630556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:13:41.631878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:13:41.632791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:13:41.646541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:41.647113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:41.647663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:41.648631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:41.649166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:41.649669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:41.669673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Getting quotas for project 07cb899fe6934c27820d1329375e044d. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:13:41.674026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Getting quotas for user 3e4eccc7ece24cf4bcfee361d3342a4f and project 07cb899fe6934c27820d1329375e044d. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:13:41.685414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:13:41.687844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:13:41.739156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0e14491a-8e92-4ad4-b0ce-757a6caa884b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806497 Sep 13 14:13:41.739946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 90/198] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 14:13:41.751405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1de3a7d-7167-4537-b2c4-1f0a5eaada78 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:41.752531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1de3a7d-7167-4537-b2c4-1f0a5eaada78 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:41.829984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1de3a7d-7167-4537-b2c4-1f0a5eaada78 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:41.841716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1de3a7d-7167-4537-b2c4-1f0a5eaada78 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1219 microversion: 2.1 time: 0.094388 Sep 13 14:13:41.843196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 109/199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:41 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:42.343678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:42.344575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:42.359247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:42.359906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:42.360250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:42.361099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:42.361569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:42.362257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:42.536861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:42.546621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0241b77-4bac-4322-96ab-d9509bf6c85e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.206802 Sep 13 14:13:42.547199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 91/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:42 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:42.867412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:42.868758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:42.875103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:42.875865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:42.876467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:42.877982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:42.878627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:42.879397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:42.963907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:42.972289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f01cbd74-5c8e-48af-a9ca-21e47d16cd42 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1271 microversion: 2.1 time: 0.109069 Sep 13 14:13:42.972874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 110/201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:42 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:43.572446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:43.573561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:43.583955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:43.592406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:43.594073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:43.599241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:43.600602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:43.602968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:43.882062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:43.896292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5f3ec512-c74a-485e-885f-811fae2fdc6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.327844 Sep 13 14:13:43.896872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 92/202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:43 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:43.996273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:43.996881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:44.003756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:44.004507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:44.005123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:44.006075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:44.006578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:44.007184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:44.099406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:44.112223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0175c95-e29a-4794-a128-d54f0a4828ef tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1277 microversion: 2.1 time: 0.118894 Sep 13 14:13:44.112969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 111/203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:43 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:44.920763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:44.921973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:44.933631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:44.934295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:44.934896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:44.935769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:44.936217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:44.936798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:45.148037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:45.148862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:45.149593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:45.156045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6a26e89b-ca70-400a-bad7-d950d9a288ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.239217 Sep 13 14:13:45.156626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 93/204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:44 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:45.161046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:45.163886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:45.165316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:45.167265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:45.167733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:45.168167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:45.373364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:45.383903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-077b2c19-0566-4c9f-8928-a85d78794d25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.246266 Sep 13 14:13:45.385608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 112/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:45 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:45.818189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-ac84db21-bd7d-48f1-932f-3b9bf4fcc230 req-21b86480-8dde-4c10-bf85-eb258af7c9ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb9652a-f075-48fa-8725-baf081ae174b", "tag": "3414c75f-6a03-49f6-bdd4-07d2ef7d2177"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:45.836181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ac84db21-bd7d-48f1-932f-3b9bf4fcc230 req-21b86480-8dde-4c10-bf85-eb258af7c9ec service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:45.836945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ac84db21-bd7d-48f1-932f-3b9bf4fcc230 req-21b86480-8dde-4c10-bf85-eb258af7c9ec service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:45.837860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ac84db21-bd7d-48f1-932f-3b9bf4fcc230 req-21b86480-8dde-4c10-bf85-eb258af7c9ec service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:45.851730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-ac84db21-bd7d-48f1-932f-3b9bf4fcc230 req-21b86480-8dde-4c10-bf85-eb258af7c9ec service nova] Creating event network-changed:3414c75f-6a03-49f6-bdd4-07d2ef7d2177 for instance 6cb9652a-f075-48fa-8725-baf081ae174b on hv-cinder-85743 Sep 13 14:13:45.858125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-ac84db21-bd7d-48f1-932f-3b9bf4fcc230 req-21b86480-8dde-4c10-bf85-eb258af7c9ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046312 Sep 13 14:13:45.859215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 94/206] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:46.180532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:46.181362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:46.187723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:46.188548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:46.189196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:46.190982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:46.191823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:46.192553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:46.401398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:46.414724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:46.416097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:46.419534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77fe5157-a2df-40a5-b04e-0140f30aabab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.242750 Sep 13 14:13:46.420244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 113/207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:46 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:46.433173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:46.434333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:46.435760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:46.436487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:46.437045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:46.437626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:46.604284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:46.612593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32271c83-cebf-4f6a-9acb-d3082b5f0b5c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.207264 Sep 13 14:13:46.613164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 95/208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:46 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:47.446505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:47.447254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:47.454178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:47.458643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:47.459107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:47.459859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:47.460360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:47.460814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:47.635033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:47.636297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:47.643661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:47.654501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eaaeecbb-cc02-4282-80c7-b886e51117f4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.212023 Sep 13 14:13:47.656830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:47.657327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:47.657776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:47.659401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:47.659858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:47.660280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:47.662399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 114/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:47 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:47.922619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:47.932471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28cc8790-7b9e-4a2e-bff8-aab329976429 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.300753 Sep 13 14:13:47.933172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 96/210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:47 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:48.678763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:48.679404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:48.685851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:48.686337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:48.686781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:48.691480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:48.691480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:48.691480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:48.825941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:48.836106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60219b24-f0db-42c1-8904-78a2ee50015a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.161442 Sep 13 14:13:48.836844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 115/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:48 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:48.956726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:48.957411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:48.963919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:48.964408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:48.964838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:48.965533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:48.966013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:48.966434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:49.111719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:49.119538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ea9f71a-9818-43d5-9a7f-ae548ec6c08e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.166867 Sep 13 14:13:49.120096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 97/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:48 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:49.860259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:49.860954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:49.867721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:49.868215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:49.868651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:49.869342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:49.869821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:49.870247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:50.011992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:50.019763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-197855ad-f19c-49e8-b867-fba44ba97a2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.163502 Sep 13 14:13:50.020330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 116/213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:49 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:50.142747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:50.143996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:50.150643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:50.151124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:50.151551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:50.152246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:50.152694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:50.153109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:50.334770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:50.342704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6445d382-1a27-430d-a8c7-4420fd1ae129 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.203809 Sep 13 14:13:50.343278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 98/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:50 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:51.044555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:51.045160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:51.051442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:51.051928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:51.052355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:51.053074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:51.053528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:51.054119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:51.200898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:51.209834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75c55fc0-0d90-49fd-9149-ae0c1412a496 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.169242 Sep 13 14:13:51.210410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 117/215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:51 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:51.368555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:51.369293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:51.376615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:51.377810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:51.378250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:51.378939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:51.379566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:51.380161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:51.385006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:51.533424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:51.542102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32e492c1-bdf3-44bc-a2d1-9da4dbb515c6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.177532 Sep 13 14:13:51.542679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 99/216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:51 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:52.236564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:52.237639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:52.243582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:52.245375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:52.246464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:52.247121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:52.248353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:52.248987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:52.249502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:52.427592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:52.435652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ede3588-7669-40aa-a5be-4bf335ed6de6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.204878 Sep 13 14:13:52.436336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 118/217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:52 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:52.566773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:52.567418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:52.569204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:52.569883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:52.575950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:52.576429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:52.576860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:52.577541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:52.578023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:52.578447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:52.702170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:52.709930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-465773ee-f666-49aa-a4e5-09692e7d5b08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.147040 Sep 13 14:13:52.710478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 100/218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:52 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:53.460303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:53.460897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:53.467288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:53.467761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:53.468203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:53.468864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:53.469311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:53.469743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:53.603709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:53.612457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-014a5969-764e-4293-ae7c-c271722aec2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.155670 Sep 13 14:13:53.613190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 119/219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:53 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:53.733068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:53.733671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:53.740925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:53.741404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:53.741867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:53.742553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:53.743012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:53.743433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:53.871419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:53.879655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf7397aa-3d7f-43aa-9e18-53e477bdf3a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.150520 Sep 13 14:13:53.880211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 101/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:53 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:54.636463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:54.637131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:54.643888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:54.644368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:54.644801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:54.645482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:54.646215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:54.646634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:54.771744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:54.779451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-307142bc-a789-47d8-a686-0284f13e65c3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.146911 Sep 13 14:13:54.780015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 120/221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:54 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:54.902665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:54.903256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:54.909627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:54.910135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:54.910570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:54.911252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:54.911705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:54.912126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:55.040223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:55.048087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2a367824-1c80-42ea-af5c-3cd48dc15762 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.149308 Sep 13 14:13:55.049186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 102/222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:54 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:55.762861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-25910505-c75d-48ab-adcc-cf4b57f8b191 req-02a88dae-f9d2-42dd-9b29-363f4cc99a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb9652a-f075-48fa-8725-baf081ae174b", "name": "network-vif-plugged", "status": "completed", "tag": "3414c75f-6a03-49f6-bdd4-07d2ef7d2177"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:13:55.774497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-25910505-c75d-48ab-adcc-cf4b57f8b191 req-02a88dae-f9d2-42dd-9b29-363f4cc99a7e service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:55.774983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-25910505-c75d-48ab-adcc-cf4b57f8b191 req-02a88dae-f9d2-42dd-9b29-363f4cc99a7e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:55.775430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-25910505-c75d-48ab-adcc-cf4b57f8b191 req-02a88dae-f9d2-42dd-9b29-363f4cc99a7e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:55.787565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-25910505-c75d-48ab-adcc-cf4b57f8b191 req-02a88dae-f9d2-42dd-9b29-363f4cc99a7e service nova] Creating event network-vif-plugged:3414c75f-6a03-49f6-bdd4-07d2ef7d2177 for instance 6cb9652a-f075-48fa-8725-baf081ae174b on hv-cinder-85743 Sep 13 14:13:55.792687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-25910505-c75d-48ab-adcc-cf4b57f8b191 req-02a88dae-f9d2-42dd-9b29-363f4cc99a7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033484 Sep 13 14:13:55.793309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 121/223] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:13:55.802358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:55.802959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:55.811568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:55.812466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:55.813137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:55.814754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:55.815561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:55.816332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:55.950381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:55.958752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c3e3e387-1746-4d1a-aee1-3bd87592756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.160281 Sep 13 14:13:55.959301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 103/224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:55 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:13:56.072783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:56.073673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:56.080733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:56.081227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:56.081658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:56.082388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:56.082839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:56.083260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:56.230460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:56.238899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3044aa7f-77e7-4fde-8e70-857da82d7941 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.171160 Sep 13 14:13:56.239485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 122/225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:56 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:56.982808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:56.983405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:56.990162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:56.990630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:56.991055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:56.991738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:56.992186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:56.992599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:57.124151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:57.132204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d42de23-71d6-4c1e-8558-538da7c96708 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.153117 Sep 13 14:13:57.132764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 104/226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:56 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:57.263145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:57.263145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:57.269503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:57.270086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:57.270551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:57.271747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:57.272112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:57.272541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:57.405118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:57.413944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffc74f1f-6245-463c-b5d0-89d9597ff8ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.155335 Sep 13 14:13:57.414511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 123/227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:57 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:58.155652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:58.156177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:58.162924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:58.163400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:58.163849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:58.164530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:58.164979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:58.165399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:58.296339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:58.304762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5e467f4-a9ab-4b74-8b72-172fde5473d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.153033 Sep 13 14:13:58.305318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 105/228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:58 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:58.436318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:58.436872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:58.442916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:58.443408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:58.443824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:58.444500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:58.444950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:58.445366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:58.579264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:58.588192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e3da897-a84b-41f0-a15e-758b809d909e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.155673 Sep 13 14:13:58.588763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 124/229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:58 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:59.329638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:59.330265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:59.337220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:59.337691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:59.338143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:59.338818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:59.339264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:59.339679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:59.468116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:59.476270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e258a81-c56b-4d68-9985-fb6a92082f05 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.150737 Sep 13 14:13:59.476821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 106/230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:59 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:13:59.611218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:13:59.611847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:13:59.618709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:59.619355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:59.619788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:59.620481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:13:59.620929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:13:59.621345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:13:59.753370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:13:59.756842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:13:59.761845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71cb30a7-edeb-40b9-94d2-b49808a38abb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.155058 Sep 13 14:13:59.762422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 125/231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:13:59 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:00.499976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:00.500589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:00.507403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:00.507894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:00.508318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:00.509013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:00.509470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:00.509926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:00.661047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:00.669423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-401aa290-ac34-48e4-85cf-206576db060b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1521 microversion: 2.1 time: 0.173258 Sep 13 14:14:00.670031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 107/232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:00 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:00.789265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:00.790033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:00.796490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:00.796984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:00.797416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:00.798142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:00.798594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:00.799012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:00.942609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:00.951525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15a532aa-4893-432c-8bc6-a323681bfc7d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.167467 Sep 13 14:14:00.952101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 126/233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:00 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:01.692564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:01.693215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:01.699804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:01.700376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:01.700819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:01.701570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:01.702049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:01.702466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:01.850583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:01.858295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9f681b54-c7ea-42af-bda0-41254f42af0a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1501 microversion: 2.1 time: 0.169722 Sep 13 14:14:01.859032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 108/234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:01 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:01.884165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:01.884857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:01.891030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:01.891610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:01.892124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:01.892890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:01.894403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:01.894903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:01.975736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:01.977483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:01.983975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:01.984768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:01.985267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:01.986061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:01.987439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:01.988681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:02.035754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:02.044257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32f84d9f-f45d-4a2b-87d7-b516cde61e11 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1516 microversion: 2.1 time: 0.163857 Sep 13 14:14:02.045780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 127/235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:01 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:02.153075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:02.163068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4ff5cd15-e3fe-4598-bb46-deb20b69f830 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1319 microversion: 2.1 time: 0.191115 Sep 13 14:14:02.166415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 109/236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:01 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:03.186976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:03.187620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:03.194020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:03.194500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:03.194926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:03.196230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:03.196686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:03.197107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:03.335002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:03.342705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5554ebc3-b758-4a4d-9025-adbb22bb0cff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1509 microversion: 2.1 time: 0.159530 Sep 13 14:14:03.343283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 128/237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:03 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:03.473193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:03.475558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:03.483455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:03.484318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:03.484887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:03.485845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:03.488473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:03.489449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:03.523450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lazy-loading 'flavor' on Instance uuid 1791b49a-ae8a-4b9d-a575-dc20ba423604 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:14:03.649110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33b96220-6d90-4d35-b62f-8f65d69db505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/action" status: 200 len: 32 microversion: 2.1 time: 0.180559 Sep 13 14:14:03.649814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 110/238] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:14:03 2022] POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 14:14:03.659749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:03.660354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:03.666783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:03.667472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:03.668079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:03.668942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:03.669633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:03.670110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:03.854833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:03.865974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ecc7d463-f0bc-430e-9d26-68e98cc64cf0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.210441 Sep 13 14:14:03.867341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 129/239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:03 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:04.891505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:04.892113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:04.899546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:04.900058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:04.900487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:04.901173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:04.901618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:04.902058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:05.036593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:05.044449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-14a1dff4-dd1d-4d5a-a5fb-07c138330830 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.157823 Sep 13 14:14:05.045307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 111/240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:04 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:06.068141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:06.068971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:06.077980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:06.077980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:06.077980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:06.077980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:06.078380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:06.078964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:06.220242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:06.232282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cb5fafe-b635-48af-bafd-6f6cb94ee901 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.168037 Sep 13 14:14:06.232868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 130/241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:06 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:07.256751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:07.257362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:07.263942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:07.264459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:07.264976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:07.265790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:07.266366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:07.266844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:07.409050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:07.417434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b9d951b-7309-4d03-a7f1-7a7ce9960e37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.164894 Sep 13 14:14:07.418105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 112/242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:07 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:08.441470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:08.442053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:08.451342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:08.452653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:08.453106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:08.453848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:08.454318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:08.454747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:08.624555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:08.634417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2abbc77-9afd-4b6f-8f5c-d5565736a66c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.197173 Sep 13 14:14:08.645836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 131/243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:08 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:09.668468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:09.670540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:09.677368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:09.679931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:09.680942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:09.681417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:09.682150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:09.682606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:09.683024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:09.927982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:09.931676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:09.942499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-418391a8-3d9c-42b7-9690-81197f240623 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.278004 Sep 13 14:14:09.943397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 113/244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:09 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:10.965799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:10.966401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:10.969828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:10.973948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:10.974571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:10.975224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:10.976218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:10.976758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:10.977382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:11.202300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:11.210924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-793dfa3d-bb67-47ef-a855-76384ee87d76 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.248730 Sep 13 14:14:11.226452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 132/245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:10 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:12.237709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:12.239002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:12.247693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:12.248504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:12.249082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:12.250199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:12.250803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:12.251222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:12.430243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:12.440568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56896a3b-019d-43b9-b96d-6580faaa1ce8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.207181 Sep 13 14:14:12.442133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 114/246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:12 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:13.466664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:13.468185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:13.481779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:13.482262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:13.482862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:13.483741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:13.488633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:13.489117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:13.675968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:13.686085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b44471d-5c1b-415c-b7f6-c591a6633e1b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.223846 Sep 13 14:14:13.686821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 133/247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:13 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:14.717790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:14.719134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:14.741547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:14.741900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:14.746218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:14.747134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:14.747629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:14.748067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:15.025032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:15.038043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4a0a8524-0b9f-4f48-9dc2-e60954b7f3ab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.332076 Sep 13 14:14:15.039391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 115/248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:14 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:15.356128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:15.356782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:15.367739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:15.368255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:15.368710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:15.373988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:15.374524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:15.374967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:15.409279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc430995-173f-473c-8d23-8941dd126f45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/ips" status: 200 len: 146 microversion: 2.1 time: 0.057041 Sep 13 14:14:15.417267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 134/249] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:14:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/ips => generated 146 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:15.518881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:15.519360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:15.536688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:15.543382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:15.547788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:15.555578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:15.556071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:15.556515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:15.593872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-13132531-379f-4187-847e-5049a700c740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/ips" status: 200 len: 152 microversion: 2.20 time: 0.080066 Sep 13 14:14:15.602818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 116/250] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Sep 13 14:14:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/ips => generated 152 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:14:16.073077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:16.073280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:16.088033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:16.088689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:16.089238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:16.090103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:16.090674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:16.091467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:16.466277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:16.477952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd7953cd-3f76-4bf5-9f04-5b760123e339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.418079 Sep 13 14:14:16.482214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 135/251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:16 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:17.505632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:17.506297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:17.530732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:17.530732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:17.531056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:17.531930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:17.532530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:17.533977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:17.900315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:17.910949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6bdfbcd-87e7-4114-9f6d-ddef942502d8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.409725 Sep 13 14:14:17.911884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 117/252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:17 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:18.936998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:18.937956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:18.945722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:18.946806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:18.947460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:18.948265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:18.948986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:18.949643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:19.351527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:19.352660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:19.360858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:19.361488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:19.370633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:19.372043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:19.372992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:19.373635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:19.409931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lazy-loading 'flavor' on Instance uuid 7b2c4488-4c00-4d44-ae73-a78e48c07a1b {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:14:19.415725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:19.433960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be4ae1d7-b2d7-4e78-9e12-52969742bd13 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.492289 Sep 13 14:14:19.434885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 136/253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:18 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:19.716607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3285cf05-eb0f-481a-8292-3d74db31b195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/action" status: 202 len: 0 microversion: 2.20 time: 0.368423 Sep 13 14:14:19.720866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 118/254] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 13 14:14:19 2022] POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:14:19.727389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:19.728394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:19.744806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:19.745537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:19.746180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:19.747115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:19.748495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:19.749339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:19.959931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:19.970143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:19.973777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:19.975203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-710c97c4-7aef-4ce3-9a88-42eb23c58f59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.253161 Sep 13 14:14:19.981896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 137/255] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:20.427066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:20.427753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:20.434558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:20.435343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:20.436005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:20.436924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:20.437576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:20.438222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:20.459340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:20.459956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:20.470104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:20.471668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:20.472308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:20.473027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:20.473625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:20.476202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:20.492210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a016f2ef-c6a5-4311-96ee-4637afbbb0a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/ips" status: 200 len: 149 microversion: 2.1 time: 0.070641 Sep 13 14:14:20.495381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 119/256] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:14:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/ips => generated 149 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:20.850862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:20.862292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42c513af-5682-45f5-970b-5373853fb987 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.406580 Sep 13 14:14:20.874004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 138/257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:20 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:21.018290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:21.019278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:21.033821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:21.035734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:21.037051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:21.038289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:21.039955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:21.041253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:21.480736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:21.500841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:21.505781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:21.506988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0db964ef-7b7b-483c-8599-5550fe2bbb52 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.500516 Sep 13 14:14:21.510344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 120/258] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:21.890098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:21.890796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:21.897924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:21.899334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:21.900027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:21.901255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:21.902819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:21.903481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:22.063008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:22.074669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db0ce2aa-b308-4861-903e-fde85164f288 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.190113 Sep 13 14:14:22.082450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 139/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:21 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:22.393399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a89f271-5896-4a9e-849b-3e72cfcf9c6e"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:22.405907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:22.417540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:22.418611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:22.419891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:22.420833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:22.421773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:22.422586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:22.542553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:22.543428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:22.556537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:22.558370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:22.559043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:22.560918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:22.562205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:22.563939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:22.909199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:22.926712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:22.929747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:22.931651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c91f8e61-427a-410a-8812-6b1929192022 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.394291 Sep 13 14:14:22.932833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 140/260] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:22.945163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e6782dac-d92c-4d30-998c-789440e352cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556270 Sep 13 14:14:22.946208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 121/261] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:14:22 2022] POST /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 194 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:22.957604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1c32e17-7d37-4694-a367-e267db9b75c8"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:22.960202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:22.967524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:22.968245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:22.969910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:22.971863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:22.972492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:22.973074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:23.102183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:23.102661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:23.112429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:23.112919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:23.113356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:23.114097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:23.114550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:23.118617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:23.544381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:23.553548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ce3fd58c-83e3-4e5e-80bc-8b72c85c2337 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.456197 Sep 13 14:14:23.555371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 122/262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:23 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:23.967627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:23.968491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:23.979612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:23.980589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:23.981263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:23.982567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:23.983350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:23.983981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:24.168082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:24.179292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:24.181010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:24.182807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5cc1d3c-c2ee-470b-b7f0-ac2213d2cc4f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.219532 Sep 13 14:14:24.183614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 123/263] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:24.576614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:24.577765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:24.587101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:24.588096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:24.588853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:24.590061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:24.590718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:24.591349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:24.761852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:24.773344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1228158a-b292-4a04-9d67-6fbd2ed4e2c4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.200587 Sep 13 14:14:24.786696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 124/264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:24 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:25.212832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:25.213805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:25.225820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:25.226408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:25.227034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:25.227863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:25.228703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:25.229175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:25.445672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:25.457677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:25.461227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:25.462846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-932e5d06-79fc-4767-a905-4e301b02b819 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.253840 Sep 13 14:14:25.463893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 125/265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:25.799473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:25.800003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:25.806496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:25.807281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:25.808068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:25.809127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:25.809965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:25.810563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:25.957139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:25.965626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d22f6d9-007f-4bf5-bd2c-d6d8bb2f056b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.170714 Sep 13 14:14:25.966230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 126/266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:25 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:26.488532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:26.489184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:26.500882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:26.501513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:26.502046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:26.502805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:26.503259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:26.503680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:26.890004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:26.919009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a77ed4f-2395-4c51-a0cb-a31d35a9e04a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.984610 Sep 13 14:14:26.947133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 141/267] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:14:22 2022] POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 194 bytes in 4013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:26.949794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:26.960703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:26.970129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:26.972017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:26.974324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3ce04977-9ce7-49ca-9e75-2c62e0d5f6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.488792 Sep 13 14:14:26.995132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:26.996520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:26.997807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 127/268] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:14:27.012442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:27.012563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:27.013018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:27.013669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:27.016573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:27.017623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:27.212765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:27.223327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f596aeda-bc83-433f-8fe6-743ac9dab232 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.237679 Sep 13 14:14:27.239154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 142/269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:26 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:28.007758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:28.009004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:28.017691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:28.018361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:28.019004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:28.019703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:28.020151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:28.020834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:28.167957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:28.177059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:28.178790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:28.179937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-14d7f2e1-17f7-4d44-8a6d-94e29c9f543b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.177440 Sep 13 14:14:28.180808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 128/270] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:28.252309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:28.252912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:28.259524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:28.260178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:28.260612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:28.261302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:28.261775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:28.262370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:28.422265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:28.431836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d10f43d5-a4da-4865-8bee-776cc8d50675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.185439 Sep 13 14:14:28.443296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 143/271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:28 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:29.206973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:29.207579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:29.214369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:29.215030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:29.215636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:29.216490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:29.216937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:29.217519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:29.459462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:29.459462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:29.471513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:29.472435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:29.473034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:29.473969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:29.474580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:29.475148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:29.532194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:29.544384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:29.546061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:29.548917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ffca23e-72cf-4632-b3ad-e59015f8f1a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.345848 Sep 13 14:14:29.563609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 129/272] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:29.667076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:29.678176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ad786f3-d473-4b39-9a82-6fd84d80ff32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.224256 Sep 13 14:14:29.678756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 144/273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:29 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:30.577669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:30.581559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:30.588214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:30.588961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:30.589598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:30.590845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:30.591769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:30.592406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:30.617427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f00280d-d01c-4f9f-a510-7455422a5dcb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'create', calling method: .version_select at 0x7fc9d42b04c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1797991648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBK3aKtP5uJYSsGGy5GlZ+R9qAVvrjtrx6vsCMzPD6f9+ZxcRPLyCI+fn1WHhN8i5dwii75qGm9nLK5hEwrDpsepBb3LQic8zpwvYx7JyvUrnczkb+hze7CHePzIKQv2hw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:30.642878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6f00280d-d01c-4f9f-a510-7455422a5dcb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Getting quotas for project e9946e78bebe4d2a8d32a39120b0b978. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:30.647537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6f00280d-d01c-4f9f-a510-7455422a5dcb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Getting quotas for user b894ea45ef5f4dcca7ced8cd7834a25a and project e9946e78bebe4d2a8d32a39120b0b978. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:30.695671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f00280d-d01c-4f9f-a510-7455422a5dcb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.082248 Sep 13 14:14:30.696268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 145/274] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:14:30 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:30.705937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:30.706698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:30.713151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:30.713640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:30.714367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:30.715216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:30.715792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:30.716337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:30.803526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:30.818586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:30.818586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:30.820326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8044c415-702a-49e6-b544-2126667454e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.246599 Sep 13 14:14:30.821251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 130/275] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:30.853496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-670565765", "imageRef": "ecb7aacc-1536-4cd0-8796-c747e91620d6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1797991648", "networks": [{"uuid": "18aefeb3-e097-40a1-b6c5-033f85780f12"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:30.873951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:30.882845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7253da91-f62d-4422-9231-54dd0e8fbddb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.181623 Sep 13 14:14:30.883425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 146/276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:30 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:30.909398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] validate_networks() for [('18aefeb3-e097-40a1-b6c5-033f85780f12', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:14:31.321700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:14:31.322169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:14:31.322676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:14:31.323088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:14:31.323503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:14:31.332128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:31.332613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:31.333047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:31.333803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:31.334260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:31.334684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:31.352340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Getting quotas for project e9946e78bebe4d2a8d32a39120b0b978. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:31.356533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Getting quotas for user b894ea45ef5f4dcca7ced8cd7834a25a and project e9946e78bebe4d2a8d32a39120b0b978. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:31.368662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:14:31.370981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ecb7aacc-1536-4cd0-8796-c747e91620d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:14:31.431754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e34454c6-da86-4612-911a-7eb83072ab23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582166 Sep 13 14:14:31.432416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 131/277] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 14:14:31.443882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83927101-8da5-4aae-a570-9b857d08f246 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:31.444955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83927101-8da5-4aae-a570-9b857d08f246 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:31.504143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83927101-8da5-4aae-a570-9b857d08f246 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:31.513387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83927101-8da5-4aae-a570-9b857d08f246 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1258 microversion: 2.1 time: 0.073480 Sep 13 14:14:31.514529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 147/278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:31.710153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6757c48-affb-4f74-bab3-d58a5bc3ac78", "device": "/dev/sdb"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:31.713764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:31.723792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:31.724287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:31.724725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:31.725440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:31.726008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:31.726690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:31.848437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:31.849083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:31.857906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:31.858390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:31.858829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:31.859583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:31.860037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:31.860455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:32.006476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:32.014624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:32.016078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:32.018032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94441147-e76b-4277-8571-1311fc673a7e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.174519 Sep 13 14:14:32.018573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 148/279] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:14:32.023084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:32.023676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:32.029244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:32.029710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:32.030174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:32.030849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:32.031302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:32.031716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:32.159255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:32.167449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c51fa45-ab36-458f-bc55-99486b5e9823 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.147873 Sep 13 14:14:32.168097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 149/280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:32 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:32.347791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-84f53f22-8acf-408f-9b84-8f4f6eac7c46 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "POST /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641783 Sep 13 14:14:32.348724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 132/281] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:14:31 2022] POST /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:32.536921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:32.537832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:32.555946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:32.557698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:32.558345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:32.559480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:32.562961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:32.563412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:32.632138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:32.641130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-972fadba-d430-4886-87fe-434c6cd5191b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1254 microversion: 2.1 time: 0.108389 Sep 13 14:14:32.641692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 150/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1254 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:33.045385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:33.046186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:33.053811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:33.054279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:33.054734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:33.055435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:33.055906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:33.056311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:33.191174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:33.192443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:33.198769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:33.204667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:33.205942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:33.206399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:33.207147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:33.209282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:33.214694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:33.216280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:33.217458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c868980-dbca-413a-bb39-e899c79f4c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.176903 Sep 13 14:14:33.218069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 133/283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:33.218842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:33.496344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:33.504222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94a18595-ee3d-4faf-92ff-60678f7a6cb3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.317477 Sep 13 14:14:33.504782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 151/284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:33 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:33.664961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:33.665577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:33.672107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:33.672587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:33.673060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:33.673864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:33.674328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:33.674755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:33.735236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:33.742854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-618fffac-718e-462f-af13-fe81c3c7708e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1310 microversion: 2.1 time: 0.081892 Sep 13 14:14:33.743557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 134/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1310 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:34.246085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:34.246685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:34.253599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.254103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.254533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.255221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.255731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.256162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.391345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:34.400453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:34.401913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:34.403061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a83316e3-c650-4f33-aee8-a5c05511ce0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.160773 Sep 13 14:14:34.403609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 152/286] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:34.533196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:34.533857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:34.541211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.541698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.542184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.542883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.543566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.543991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.743313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:34.752712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-924c6365-06da-4b7f-a9e3-fd4956041cb9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1502 microversion: 2.1 time: 0.225518 Sep 13 14:14:34.770860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 135/287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:34 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:34.771057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:34.771057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:34.773719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.774299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.774824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.775595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.776119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.776656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.783731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c10ab717-9eea-4323-a222-930e5fa4c83f"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:34.787072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:34.794342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.794830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.795473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.797160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.798707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.799391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.824782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] HTTP exception thrown: Cannot 'attach_volume' instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 while it is in vm_state rescued Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Request method failure captured: Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/os-volume_attachments HTTP/1.1 Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 74 Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_JYRbhyUnmM--PN1SJeA6-9ligOC4uft0fibnjgJeV3l5Q8ijCT4TiXANrP2BJ21v84ERQE4jDZUoW2yq4J4TyTpTw1RbDFKRAN16tFmVbpfmCdCi5YCNdxY69JJ_ol1z3UFVxWTZdqNSecoff0grl2EFbjSISmM7el7Mak29iQog Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 4a11c6709cba4247acc57bd97250f8a0 Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:14:34.826609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a11c6709cba4247acc57bd97250f8a0"}]}] Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 4a11c6709cba4247acc57bd97250f8a0 Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-ServerRescueNegativeTestJSON-54027097-project Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 961012089bd147ecab4fcdf5ea3ae4c3 Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54027097-project Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {"volumeAttachment": {"volumeId": "c10ab717-9eea-4323-a222-930e5fa4c83f"}} Sep 13 14:14:34.828031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Cannot 'attach_volume' instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 while it is in vm_state rescued Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'server_id': '1791b49a-ae8a-4b9d-a575-dc20ba423604', 'body': {'volumeAttachment': {'volumeId': 'c10ab717-9eea-4323-a222-930e5fa4c83f'}}} Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:14:34.828760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 while it is in vm_state rescued Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:14:34.830805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 while it is in vm_state rescued Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Returning 409 to user: Cannot 'attach_volume' instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 while it is in vm_state rescued {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0baa9d0-ccdd-49fe-a577-d3836143312a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053466 Sep 13 14:14:34.831894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 136/288] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:14:34 2022] POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 14:14:34.838690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:34.839229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:34.846019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.846518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.846968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.847774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.848119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.848552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.864993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:34.873775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-771da092-5c02-4fab-93b3-38c440ecace3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1318 microversion: 2.1 time: 0.111461 Sep 13 14:14:34.874629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 153/289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:34.928368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-24a2843f-af22-4745-9965-62677d69d08e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/action" status: 202 len: 0 microversion: 2.1 time: 0.093351 Sep 13 14:14:34.929770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 137/290] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:14:34 2022] POST /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:14:34.948204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:34.949059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:34.962932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.963595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.964151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:34.965540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:34.966784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:34.967859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:35.026881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5b22fd2c-5d31-4b6a-a1d5-c8d7b7a4a829 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: .version_select at 0x7fc9d4319c10>, body: {"keypair": {"name": "tempest-keypair-246693700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtxTuEKpjvcRMYm76PnMsaBXs0Qckt7uTItwy2qSK73tXWUtjL+2JzvLDR4LN/vWm1FHNBdBYIEePoE+I0KUNa2qUkte5i2gAnCfFD+YGdu1SXBS56PyEtM2AZ1+1UUnw=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:35.047245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-5b22fd2c-5d31-4b6a-a1d5-c8d7b7a4a829 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:35.051396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-5b22fd2c-5d31-4b6a-a1d5-c8d7b7a4a829 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:35.083753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5b22fd2c-5d31-4b6a-a1d5-c8d7b7a4a829 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062210 Sep 13 14:14:35.084913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 138/291] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:14:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:14:35.218345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:35.232482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9206168e-6a93-4f6b-9b72-1946d42b26b4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.287137 Sep 13 14:14:35.233228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 154/292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:34 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:35.431268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:35.431451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:35.438341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:35.439410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:35.440069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:35.441214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:35.442085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:35.442708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:35.693167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:35.708764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:35.710637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:35.712083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7983945c-b8da-4342-8b7a-316df74dc040 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.285862 Sep 13 14:14:35.722632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 139/293] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:35.899970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:35.900588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:35.913322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:35.913850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:35.914298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:35.932459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:35.933343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:35.934418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:36.056685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:36.068344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef0c8855-afcc-447b-99d4-fdc216d12d5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1316 microversion: 2.1 time: 0.172101 Sep 13 14:14:36.081822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 155/294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:36.276457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:36.277062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:36.283706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:36.284203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:36.284809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:36.285674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:36.286172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:36.286596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:36.435418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:36.459851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c7776076-f366-46b5-ae6b-552930870be4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.187279 Sep 13 14:14:36.460428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 140/295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:36 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:36.740531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:36.741280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:36.747517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:36.748080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:36.748521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:36.749220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:36.749677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:36.750144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:36.905572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:36.917493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:36.920147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:36.922559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28f6c10c-b6db-4ad5-8a79-81cfec66dd8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.186068 Sep 13 14:14:36.923111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 156/296] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:36.942448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2102689919", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90f85b86-6272-4c59-ab80-1d663e05af5b"}], "security_groups": [{"name": "tempest-securitygroup--29574555"}], "key_name": "tempest-keypair-246693700", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:37.043634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] validate_networks() for [('90f85b86-6272-4c59-ab80-1d663e05af5b', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:14:37.092442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:37.093088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:37.099329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.099847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.100282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.101016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.101467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.101923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.237628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:37.245522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4e54a48-14d8-4b5e-8341-3826fb7cde19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.156978 Sep 13 14:14:37.246118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 157/297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:37.414327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:14:37.414778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:14:37.415276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:14:37.415706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:14:37.416115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:14:37.425507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.426013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.426447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.427169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.427623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.428077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.449346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:37.453279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:37.464467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:14:37.466864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:14:37.484100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:37.484870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:37.493282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.494130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.494840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.495954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.496689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.497367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.537602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2766176d-ee1d-44fb-8786-b753afffacc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.599945 Sep 13 14:14:37.541581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 141/298] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:14:36 2022] POST /compute/v2.1/servers => generated 400 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:14:37.558969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fdcf9a3f-ab1d-4cfd-a673-a5ccdfb3c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:37.559582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fdcf9a3f-ab1d-4cfd-a673-a5ccdfb3c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:37.561617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:37.624147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fdcf9a3f-ab1d-4cfd-a673-a5ccdfb3c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:37.631289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fdcf9a3f-ab1d-4cfd-a673-a5ccdfb3c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1241 microversion: 2.1 time: 0.080417 Sep 13 14:14:37.632084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 142/299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:37 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:37.653686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:37.662643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bea0fd54-0c57-4599-8d9e-b2140565ad1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.182215 Sep 13 14:14:37.663138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 158/300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:37 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:37.948465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:37.949375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:37.956262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.956822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.957349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:37.958158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:37.958851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:37.959286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.085079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:38.093138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:38.094814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:38.096646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0ec63c4-6f52-4af7-91cb-ae852dc30831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.152251 Sep 13 14:14:38.097206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 143/301] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:38.269342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:38.269973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:38.276542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:38.277021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:38.277450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.278199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:38.278660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:38.279077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.410095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:38.417599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d5fc40a-9bab-4c54-83bc-31732ea5f22d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.153123 Sep 13 14:14:38.418176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 159/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:38.654633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:38.655318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:38.663176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:38.663969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:38.664562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.665419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:38.666119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:38.666599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.688336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:38.689391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:38.698492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:38.699224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:38.699885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.700816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:38.701543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:38.702314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:38.707877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:38.764959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:38.775981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b14f891e-6962-4df1-82fc-ffbcfe5fc07d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.125331 Sep 13 14:14:38.776935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 144/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:38 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:38.872471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:38.886070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0b22105-1394-4d56-8738-d892853feb97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.201562 Sep 13 14:14:38.887761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 160/304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:38 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:39.120617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:39.121226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:39.129131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.129928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.130353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.131061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.131522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.131952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.274645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:39.278501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:39.284691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:39.286183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:39.287384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a1d85f80-fa7e-4ff5-8d6b-2fbdc8928891 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.170857 Sep 13 14:14:39.287945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 145/305] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:39.441920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:39.442544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:39.449399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.449908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.450337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.451047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.451485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.451908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.600929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:39.609981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d212b7a-0962-4f6a-b00d-6ad9a56329de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.172885 Sep 13 14:14:39.610600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 161/306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:39.800502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:39.801110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:39.808664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.809172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.809641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.810423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.810877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.811294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.873640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:39.881782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d710fcf5-ee2e-44ba-8bca-73eae1a3a837 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.086326 Sep 13 14:14:39.882353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 146/307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:39 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:39.915300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:39.915939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:39.922581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.923070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.923507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:39.924780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:39.925787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:39.926207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.080946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:40.089833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b1f3418-4b00-4328-86bb-c046e148aa35 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.178378 Sep 13 14:14:40.090877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 162/308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:39 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:40.313371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:40.314113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:40.321226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:40.321803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:40.322244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.323006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:40.323705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:40.324288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.466508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:40.477129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:40.478635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:40.479852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28d9a13e-8b13-48d5-9282-afca2e8a88ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.170534 Sep 13 14:14:40.480411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 147/309] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:14:40.633389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:40.634036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:40.640591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:40.641080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:40.641538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.642274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:40.642818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:40.643564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.786388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:40.794745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fea806b5-eb69-48bd-9344-69a73f1f7e57 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.165267 Sep 13 14:14:40.806185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 163/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:40.905015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:40.905557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:40.911703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:40.912181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:40.912609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.913294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:40.913755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:40.914198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:40.980236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:40.988512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6248dd04-9e4f-47c8-a621-74843bc814aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.087440 Sep 13 14:14:40.989087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 148/311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:40 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:41.115091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:41.115713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:41.118835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:41.122695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:41.123221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:41.123663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:41.124363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:41.124821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:41.125245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:41.272751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:41.280654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f91248e8-0fe4-4c90-8f6a-dad9ddfffa4b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.170205 Sep 13 14:14:41.281224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 164/312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:41 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:41.505714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:41.506339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:41.513846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:41.514579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:41.515165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:41.516025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:41.516631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:41.517219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:41.692642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:41.701452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:41.703044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:41.704155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dded7c7e-23b5-445c-898b-a36ffdfed148 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.202485 Sep 13 14:14:41.704707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 149/313] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:41.818660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:41.819421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:41.821340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:41.827349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:41.827841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:41.828273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:41.828986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:41.829492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:41.830562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.004719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:42.012243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:42.013124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:42.019434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:42.019923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:42.020611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.021308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:42.021649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4d0bdcca-0d7e-4817-a3f1-3f3bc6fc3ab5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.207628 Sep 13 14:14:42.021785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:42.022199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.026379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 165/314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:42.092715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:42.102134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-93fa3e6e-936c-4260-95b0-b2e44038bbcd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.093434 Sep 13 14:14:42.102653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 150/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:42 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:42.306789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:42.307398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:42.315435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:42.316493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:42.316936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.317994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:42.318657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:42.319365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.462880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:42.471727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3e9ce21-5b61-4cb2-9b46-1040d8702a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.168728 Sep 13 14:14:42.472397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 166/316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:42 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:42.735206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:42.735940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:42.743410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:42.743890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:42.744327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.745179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:42.746174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:42.746607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:42.905603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:42.915588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:42.917171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:42.918473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89667a7c-6ed6-40d1-b888-17440cacc8aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.187906 Sep 13 14:14:42.919114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 151/317] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:43.053298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:43.054472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:43.076317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.076814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.082164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.083501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.084457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.085316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.126315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:43.128213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:43.145102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.145102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.145102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.145959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.146421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.147869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.243723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:43.252369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06cd90b1-e34e-40c6-8de2-3cdf3ffb6d5e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.130116 Sep 13 14:14:43.253371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 152/318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:43 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:43.344310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:43.355892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d520ae87-a4eb-4ad3-afa1-ebf77b8ab7ae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.307533 Sep 13 14:14:43.358459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 167/319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:43.496258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:43.496873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:43.503094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.503915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.504588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.505562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.506115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.506773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.712749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:43.722049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c7ae6993-0dee-47af-9f81-8642d420c828 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.229444 Sep 13 14:14:43.722935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 153/320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:43 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:43.948790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:43.949406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:43.956331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.957146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.958213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:43.959043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:43.959922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:43.960429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.167564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:44.179926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:44.192602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:44.194112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6fc98c0-6472-4b15-b73e-3a4439016bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.253155 Sep 13 14:14:44.194674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 168/321] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:44.277719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:44.278471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:44.289598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:44.294150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:44.294840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.295815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:44.296495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:44.297103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.377199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:44.382003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:44.383062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:44.387518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-613b72d3-6399-4808-962d-74d8f33443cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.114474 Sep 13 14:14:44.394377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:44.395186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:44.396068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.398161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 154/322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:44 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:44.399989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:44.400671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:44.401314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.657547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:44.666927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b78e50b2-eadc-4848-887a-73c5b7e56320 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.290122 Sep 13 14:14:44.667584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 169/323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:44.747391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:44.748005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:44.754995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:44.755465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:44.755903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.756607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:44.758354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:44.759120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:44.942621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:44.950450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-57aab4a6-efd5-48be-80c9-9438362de62d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.206922 Sep 13 14:14:44.955026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 155/324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:44 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:45.222307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:45.223765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:45.231676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:45.232170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:45.232745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:45.233518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:45.234065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:45.234524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:45.420905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:45.421554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:45.422414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:45.433227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:45.433479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:45.434223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:45.434861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:45.435160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:45.436098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:45.436583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-accadee6-f317-4acc-8d03-2591b8e9337b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.218619 Sep 13 14:14:45.437073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:45.441775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 170/325] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:45.442574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:45.517070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:45.534832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b5c1e918-29d1-41a2-9cd4-fe4928bc832f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.119427 Sep 13 14:14:45.535410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 156/326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:45 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:45.691695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:45.692309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:45.698950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:45.699656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:45.700315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:45.701084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:45.701547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:45.702013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:45.885968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:45.905266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bea2ca1-0658-41ea-ba86-6fb52444d3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.217357 Sep 13 14:14:45.906581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 171/327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:45.981818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:45.982431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:45.999352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.003959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.004809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.005820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.006499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.007129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.147254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:46.155232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30d169aa-2029-4cf0-a23c-a49f3b99b6ca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.177668 Sep 13 14:14:46.155810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 157/328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:45 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:46.463315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:46.464649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:46.476933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.477920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.478705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.479608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.480903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.481688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.559672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:46.560278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:46.568161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.568642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.569073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.569779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.570403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.570976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.666851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:46.675733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-40c25fd1-5f94-4536-a776-b6db2fb40643 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1245 microversion: 2.1 time: 0.119872 Sep 13 14:14:46.678415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 158/329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:46 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:46.724048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:46.732402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:46.734001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:46.735232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d030e79b-187c-4721-9bd9-44e9e17ee3f9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.276222 Sep 13 14:14:46.735794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 172/330] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:46.930744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:46.931346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:46.937106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.937584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.938066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:46.938734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:46.939809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:46.940300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.085192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:47.092809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-29cb1cf6-b433-427c-85c4-89c6c12930d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.165885 Sep 13 14:14:47.093368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 159/331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:47.184537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:47.185223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:47.193710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:47.194303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:47.194806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.196096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:47.196630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:47.197131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.330106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:47.341977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29f54521-3807-4ee8-be1f-fc49139fc263 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.165192 Sep 13 14:14:47.344087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 173/332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:47 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:47.701540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:47.702377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:47.705339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:47.706745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=18 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:47.712103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:47.712673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:47.713100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.713860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:47.714537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:47.715480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.761538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:47.762204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:47.770819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:47.771309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:47.771747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.772452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:47.772914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:47.773343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:47.801439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:47.816517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e3a7f24-165f-464a-9992-7fd02a6f3d59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1237 microversion: 2.1 time: 0.119534 Sep 13 14:14:47.817759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 160/333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:47 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:47.925098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:47.934898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:47.937878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:47.940348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1c6739a-44db-4e69-b75f-03f8f8ba6b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1723 microversion: 2.20 time: 0.182514 Sep 13 14:14:47.941843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 174/334] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:14:48.057395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-79311219-b395-4515-8a92-44cfa1e91014 req-c621df11-6ff4-47d4-b1c4-deccdaa56ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:48.067629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-79311219-b395-4515-8a92-44cfa1e91014 req-c621df11-6ff4-47d4-b1c4-deccdaa56ad5 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.068117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-79311219-b395-4515-8a92-44cfa1e91014 req-c621df11-6ff4-47d4-b1c4-deccdaa56ad5 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.068541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-79311219-b395-4515-8a92-44cfa1e91014 req-c621df11-6ff4-47d4-b1c4-deccdaa56ad5 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.083606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-79311219-b395-4515-8a92-44cfa1e91014 req-c621df11-6ff4-47d4-b1c4-deccdaa56ad5 service nova] Creating event network-changed:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:14:48.090058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-79311219-b395-4515-8a92-44cfa1e91014 req-c621df11-6ff4-47d4-b1c4-deccdaa56ad5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036118 Sep 13 14:14:48.091297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 161/335] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:48.116223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:48.119379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:48.128586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.129070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.129504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.130250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.130890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.131308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.292610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:48.300826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56bbbc95-90ff-4864-9186-5492e5d6f67b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.188427 Sep 13 14:14:48.301394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 175/336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:48.369187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:48.369626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:48.377494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.377967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.378393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.379081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.379527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.379946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.511051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:48.519216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56f677dd-1b49-4236-9f43-26bf35ea116c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.154986 Sep 13 14:14:48.540448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 162/337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:48 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:48.847887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:48.848687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:48.863201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.863836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.864693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.865987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.866942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.867590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.956374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:48.960507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:48.965266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0b522f2-94db-4a88-aada-f2109511811b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:48.969658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6000b72c-a233-491c-8901-cc9608104d9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1293 microversion: 2.1 time: 0.127653 Sep 13 14:14:48.971285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 176/338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:48 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1293 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:48.976472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:48.977255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:48.978611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0b522f2-94db-4a88-aada-f2109511811b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.981967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0b522f2-94db-4a88-aada-f2109511811b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.982495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0b522f2-94db-4a88-aada-f2109511811b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.985883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.986546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.987130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:48.988217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:48.988836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:48.989410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.052539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:49.061459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0b522f2-94db-4a88-aada-f2109511811b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Going to try to stop instance {{(pid=120642) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 14:14:49.112558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0b522f2-94db-4a88-aada-f2109511811b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/action" status: 202 len: 0 microversion: 2.1 time: 0.155603 Sep 13 14:14:49.113265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 163/339] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:14:48 2022] POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:14:49.123158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:49.124310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:49.133018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:49.134018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:49.135376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.136428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:49.137701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:49.138371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.194830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:49.205592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:49.207647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:49.208845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38fbedeb-d760-4363-9750-c05a47aba543 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1744 microversion: 2.20 time: 0.236112 Sep 13 14:14:49.209412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 177/340] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:49.323298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:49.323937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:49.330728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:49.331474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:49.331909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.332605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:49.333300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:49.333904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.487050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:49.497010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c4c197d-f343-42ec-aa3c-98c5f187242b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.177496 Sep 13 14:14:49.498095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 178/341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:49.521193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:49.529525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-078dea9c-e16e-4251-bdd1-76d347ffac9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.411186 Sep 13 14:14:49.541779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 164/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:49.557981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:49.558587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:49.564894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:49.565367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:49.565818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.566506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:49.566957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:49.567385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:49.739443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:49.747866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4e576c9-033a-48d0-984d-4f976b1d8508 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.193759 Sep 13 14:14:49.748707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 179/343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:49 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:49.996879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:49.997829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:50.005248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.005758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.006191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.006885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.007336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.007755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.078371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:50.088044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf918c86-1b51-4710-bcc1-02c4891e83f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1293 microversion: 2.1 time: 0.095297 Sep 13 14:14:50.088653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 165/344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:49 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:50.235725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:50.237482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:50.246483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.246980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.247711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.248703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.249226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.249952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.403504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:50.412984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:50.414465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:50.415614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2bf885f-e461-472e-aa27-4b3bb49ddcd5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1744 microversion: 2.20 time: 0.183786 Sep 13 14:14:50.416175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 180/345] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:50.526170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:50.527133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:50.533162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.533602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.534088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.534770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.535207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.535623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.556418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:50.557937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:50.565186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.565664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.566420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.567340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.567987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.568629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.725320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:50.729088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:50.736870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-365357e7-ee60-4404-81bf-44c828c19a24 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.220696 Sep 13 14:14:50.737448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 166/346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:50.737579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35a4deac-2d2d-4a10-8ce3-10b5fa91a7fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.186589 Sep 13 14:14:50.738466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 181/347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:50.779806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:50.780353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:50.790664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.793560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.794192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:50.800165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:50.800893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:50.801487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.045396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-aa4817c2-5777-4c35-9d05-e7d6952ae64b req-515cb0fe-3276-4358-995a-4333cebfbbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "name": "network-vif-plugged", "status": "completed", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:51.056030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:51.063012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-aa4817c2-5777-4c35-9d05-e7d6952ae64b req-515cb0fe-3276-4358-995a-4333cebfbbfd service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.063012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-aa4817c2-5777-4c35-9d05-e7d6952ae64b req-515cb0fe-3276-4358-995a-4333cebfbbfd service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.065329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-aa4817c2-5777-4c35-9d05-e7d6952ae64b req-515cb0fe-3276-4358-995a-4333cebfbbfd service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.066030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-71efaae1-dd35-4286-90a7-4fcd46c5f9ae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1510 microversion: 2.1 time: 0.291986 Sep 13 14:14:51.067054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 167/348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:50 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:51.081936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-aa4817c2-5777-4c35-9d05-e7d6952ae64b req-515cb0fe-3276-4358-995a-4333cebfbbfd service nova] Creating event network-vif-plugged:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:14:51.104038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-aa4817c2-5777-4c35-9d05-e7d6952ae64b req-515cb0fe-3276-4358-995a-4333cebfbbfd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062084 Sep 13 14:14:51.108779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 182/349] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:14:51.116825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:51.117453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:51.131158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.131885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.133190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.133983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.137034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.137506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.348721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:51.359539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6d52c747-4ddd-4aeb-8414-7eb4771ba4d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1311 microversion: 2.1 time: 0.249847 Sep 13 14:14:51.360118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 168/350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:51 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:51.442449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:51.443223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:51.449893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.450449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.451135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.451871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.452328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.452745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.602979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:51.611236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:51.612792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:51.614304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cf9e944-e7b7-45d9-b96c-bafd14073a74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1744 microversion: 2.20 time: 0.177418 Sep 13 14:14:51.615163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 183/351] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:14:51.784012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:51.785239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:51.787952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:51.789205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:51.811839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.813101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.817477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.817785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.820146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.822024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.826677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.827068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:51.827712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.830761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:51.830965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:51.835953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.088914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.097053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47f070df-5ae8-46c1-908b-31087ab2359d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.335133 Sep 13 14:14:52.097637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 169/352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:52.115249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:52.115863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:52.122589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.122753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:52.123085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:52.123525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.124226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:52.124685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:52.125118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.135587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ff9630a-d938-497e-94aa-fcad0f0dd401 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.371321 Sep 13 14:14:52.150956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 184/353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:52.305044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.312783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c127ff1b-c1ed-4c0e-a7d4-8f09a98142db tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1516 microversion: 2.1 time: 0.201798 Sep 13 14:14:52.313344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 170/354] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:52 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:52.386424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:52.387545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:52.397478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:52.398302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:52.398961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.401104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:52.401945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:52.402482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.636415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.645051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:52.645956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:52.651558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-04b54ea5-026c-414a-90f9-7d6547c02165 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.270979 Sep 13 14:14:52.652348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:52.653894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:52.654344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.655209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:52.655674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:52.656096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:52.682164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 185/355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:52 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:52.807106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.815144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.816607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:52.817766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af0e5947-ebf6-44fa-83f3-f4b2946cc37e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1744 microversion: 2.20 time: 0.177024 Sep 13 14:14:52.818350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 171/356] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:52.979460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1341765924", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "networks": [{"uuid": "f68ede55-d296-4e49-9b4a-b80ae9280285"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:53.040691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] validate_networks() for [('f68ede55-d296-4e49-9b4a-b80ae9280285', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:14:53.122167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:53.122939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:53.130056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.130469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.130913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.131653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.132148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.132541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.271929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:53.281472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97f2e222-7a9a-4bb4-a872-37d398b0da8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.163078 Sep 13 14:14:53.282079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 172/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:53.293791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:53.293791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:53.293791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.293791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.294236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.294839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.295293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.295705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.413591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:14:53.414038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:14:53.414513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:14:53.414918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:14:53.415327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:14:53.424576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.425066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.425502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.426269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.426723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.427150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.431684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:53.441719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d7ea215-b3df-47a9-b752-bea128c5e347 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.157488 Sep 13 14:14:53.442926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 173/358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:53.451605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Getting quotas for project f090725d08904bb3ae6a10598777eaa5. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:53.456466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Getting quotas for user 7479d03b6f9948e3b8a93337c19af60a and project f090725d08904bb3ae6a10598777eaa5. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:53.468321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:14:53.470671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:14:53.520859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c728f3c-028e-474a-8d47-a880182f1ad3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545261 Sep 13 14:14:53.521759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 186/359] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:14:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:14:53.532826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c6d946f-b4cb-4baa-a123-3a273445e6e9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:53.533807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c6d946f-b4cb-4baa-a123-3a273445e6e9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:53.595050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2c6d946f-b4cb-4baa-a123-3a273445e6e9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:53.607792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c6d946f-b4cb-4baa-a123-3a273445e6e9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1214 microversion: 2.1 time: 0.078022 Sep 13 14:14:53.617897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 174/360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:53 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:53.689243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:53.700121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:53.721842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.722468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.722774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.727256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.727758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.730247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.808518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2993cfe7-970f-42bb-b863-7755ff6a45e6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'create', calling method: .version_select at 0x7fc9d43b8dc0>, body: {"keypair": {"name": "tempest-keypair-1241516179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7ZkdBUCG069OFvTS2thh7kD4rPzLKrSdoO22mM86jQcOHNx1SsmH5UWex8g2x69av25x63UJ4Yc7kxl/Tq9hVvhTnVbnNXoJUiTiocgk9TEN8K0wJwsbCJJE64hzT9Tw=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:53.834481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-2993cfe7-970f-42bb-b863-7755ff6a45e6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:53.842655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-2993cfe7-970f-42bb-b863-7755ff6a45e6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for user 961012089bd147ecab4fcdf5ea3ae4c3 and project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:53.873523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2993cfe7-970f-42bb-b863-7755ff6a45e6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068696 Sep 13 14:14:53.878209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 175/361] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:14:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:14:53.898735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:53.900980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:53.921533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.923951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.927538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:53.930830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:53.932576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:53.934167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.267471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.275846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.287997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02bdd5f4-363b-435c-a808-2a5180406984 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.605773 Sep 13 14:14:54.299082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 187/362] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:53 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:54.306390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:54.307311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:54.310929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.312933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.315521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b66a7ed7-b35e-44c6-891d-c54e14206116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.435201 Sep 13 14:14:54.316258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 176/363] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:54.318622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:54.319119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:54.319616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.324004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:54.324657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:54.325439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.469251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:54.470188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:54.485264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:54.489363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:54.490253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.491979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:54.493177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:54.494130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.729815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.740867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-455ab6a8-e211-4695-a109-ec5b08d20b05 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.438356 Sep 13 14:14:54.742235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 188/364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:54.750398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:54.751878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:54.759427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:54.760264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:54.760964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.761973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:54.763754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:54.765478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:54.881938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.908659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-29095e6b-cbe1-4008-9e07-ce42b671954e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.442142 Sep 13 14:14:54.912251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:54.913309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 177/365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:54.926792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-129fc68c-3455-4126-98fe-92d508fed266 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1266 microversion: 2.1 time: 0.177112 Sep 13 14:14:54.929098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 189/366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:54 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:55.161566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-6b291899-e122-47ca-ab12-ed61af6a1c32 req-5d62e790-b0ac-4c49-9e08-046e89ec47b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef415f6-4a45-42df-8fbf-07aaec2d0cf6", "tag": "08756683-d264-47b7-80d4-fa876fa95cd9"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:55.198470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6b291899-e122-47ca-ab12-ed61af6a1c32 req-5d62e790-b0ac-4c49-9e08-046e89ec47b7 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.199389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6b291899-e122-47ca-ab12-ed61af6a1c32 req-5d62e790-b0ac-4c49-9e08-046e89ec47b7 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.200075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-6b291899-e122-47ca-ab12-ed61af6a1c32 req-5d62e790-b0ac-4c49-9e08-046e89ec47b7 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.227385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-6b291899-e122-47ca-ab12-ed61af6a1c32 req-5d62e790-b0ac-4c49-9e08-046e89ec47b7 service nova] Creating event network-changed:08756683-d264-47b7-80d4-fa876fa95cd9 for instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 on hv-cinder-85743 Sep 13 14:14:55.239292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-6b291899-e122-47ca-ab12-ed61af6a1c32 req-5d62e790-b0ac-4c49-9e08-046e89ec47b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092950 Sep 13 14:14:55.241005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 178/367] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:14:55.319848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:55.320684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:55.334725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.335305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.335965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.337636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.338301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.338937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.347575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:55.348448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:55.368032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.368744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.370127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.375106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.381284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.382007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.618090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:55.627996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3351e120-9f11-4fb5-9f3e-1c33b05f2498 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.316324 Sep 13 14:14:55.643240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 190/368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:55 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:55.765648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:55.767557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:55.777532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.782491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.784259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.787581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.788242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.788851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.883198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:55.911172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:55.915986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:55.921627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6bda654f-104e-4e86-85d4-07dfdd89c2a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.580905 Sep 13 14:14:55.924793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 179/369] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:14:55.942016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:55.946112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:55.958372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.961693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.962315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:55.963181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:55.963783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:55.966316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:56.092338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:56.103889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8718b840-ed08-4fcc-81d6-38789649b2b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.343051 Sep 13 14:14:56.106163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 191/370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:56.117434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:56.120597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:56.131941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:56.132614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:56.133061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:56.133802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:56.134268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:56.134697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:56.218266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:56.232123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e979761-aee7-4d80-8e63-64494a4b090e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1272 microversion: 2.1 time: 0.122694 Sep 13 14:14:56.233149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 192/371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:56 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:56.276531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:56.285984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b27ad253-06dd-434f-be19-c688072bcf47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.355170 Sep 13 14:14:56.287637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 180/372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:56.652513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:56.653435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:56.662394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:56.662883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:56.663520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:56.664391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:56.665018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:56.665440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:56.887799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:56.900127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f22791a5-c4ac-4e96-b705-32dc5511da48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.251358 Sep 13 14:14:56.901018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 193/373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:56 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:56.956871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:56.959604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:56.974555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:56.978879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:56.981616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:56.982657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:56.998534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:57.000951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:57.011797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-991431203", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "331e6015-f29a-4324-85ce-4db46e43b03f"}], "security_groups": [{"name": "tempest-securitygroup--785080587"}], "key_name": "tempest-keypair-1241516179", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:57.090820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:57.356724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] validate_networks() for [('331e6015-f29a-4324-85ce-4db46e43b03f', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:14:57.436425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:57.447521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:57.449184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:57.452203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f050420b-4f5d-4a59-982d-23f426ef6768 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.501995 Sep 13 14:14:57.470705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 181/374] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:57.478878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:57.479588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:57.496422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:57.498315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:57.498944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:57.502166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:57.502935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:57.504710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:57.807036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:57.817616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e083a61a-f6d4-4ff9-a670-a868791ecde5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.345452 Sep 13 14:14:57.824335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 182/375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:57.834019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:57.835082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:57.867441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:57.870349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:57.871041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:57.872156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:57.874927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:57.877054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.205938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:14:58.215327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:14:58.216340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:14:58.216987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:14:58.217709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:14:58.229293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.230157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.230789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.231721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.232426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.233094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.253436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:14:58.258243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Getting quotas for user 961012089bd147ecab4fcdf5ea3ae4c3 and project 4a11c6709cba4247acc57bd97250f8a0. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:14:58.263875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:58.273855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:14:58.276716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:14:58.286177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7a9de216-8924-48a6-b1e6-53a561b2eb2c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.455711 Sep 13 14:14:58.288898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 183/376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:57 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:58.298156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-23ac5764-4d58-4997-914b-46cde80f6178 req-3ce27210-7549-408b-9fcd-7878e072a5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "name": "network-vif-plugged", "status": "completed", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:58.316696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-23ac5764-4d58-4997-914b-46cde80f6178 req-3ce27210-7549-408b-9fcd-7878e072a5d5 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.317566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-23ac5764-4d58-4997-914b-46cde80f6178 req-3ce27210-7549-408b-9fcd-7878e072a5d5 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.318295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-23ac5764-4d58-4997-914b-46cde80f6178 req-3ce27210-7549-408b-9fcd-7878e072a5d5 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.338984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-23ac5764-4d58-4997-914b-46cde80f6178 req-3ce27210-7549-408b-9fcd-7878e072a5d5 service nova] Creating event network-vif-plugged:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:14:58.367044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-23ac5764-4d58-4997-914b-46cde80f6178 req-3ce27210-7549-408b-9fcd-7878e072a5d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074015 Sep 13 14:14:58.369665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 184/377] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:58.382661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:58.383938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:58.403205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a4d573d-edd4-43ee-bc73-fc31f09f971c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.397076 Sep 13 14:14:58.405163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:58.413131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 194/378] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:14:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:14:58.419410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:58.420252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:58.427980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.428783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.429387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.430376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.431100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.431374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.431934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.432307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.432568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.433303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.434023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.434855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.459836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:58.676135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:58.691014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5145320c-6b5e-4427-9cee-7c3a2a45bc88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.270828 Sep 13 14:14:58.692849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 195/379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:58 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:58.698966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6af8006d-01b3-495f-b226-5b88cca30da4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:58.699838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6af8006d-01b3-495f-b226-5b88cca30da4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:58.743468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:58.779661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-085c593b-07fb-43f8-be65-bbd674e64658 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.407067 Sep 13 14:14:58.785770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 185/380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:58.797467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:58.799254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:58.813592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.816829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.817376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.819097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.824088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af8006d-01b3-495f-b226-5b88cca30da4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:58.827997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.828458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.832625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6af8006d-01b3-495f-b226-5b88cca30da4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1245 microversion: 2.1 time: 0.138518 Sep 13 14:14:58.833462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 196/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1245 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:58.857256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:58.858142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:58.883420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.886043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.887655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:58.890282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:58.895521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:58.898650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.077424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:59.086934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b7b2929-c7e9-4565-84b3-b5e8a7034d32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.234216 Sep 13 14:14:59.103327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 197/382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:14:59.135817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:59.144749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:59.147293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:59.148770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8602cd70-b03b-411b-ab3a-f7d012979f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.361603 Sep 13 14:14:59.162013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 186/383] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:14:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:14:59.244631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-f12954df-db9f-4153-be36-17a718d8652f req-d2ca8566-b509-4f3c-914c-63c002530bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2fd805-47b4-4a80-b6b9-59570b95d010", "tag": "7d0a5969-b1b9-44e1-be0d-aca6d57e8f28"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:14:59.261442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:14:59.263958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f12954df-db9f-4153-be36-17a718d8652f req-d2ca8566-b509-4f3c-914c-63c002530bb0 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.264933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f12954df-db9f-4153-be36-17a718d8652f req-d2ca8566-b509-4f3c-914c-63c002530bb0 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.265582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f12954df-db9f-4153-be36-17a718d8652f req-d2ca8566-b509-4f3c-914c-63c002530bb0 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.281975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-f12954df-db9f-4153-be36-17a718d8652f req-d2ca8566-b509-4f3c-914c-63c002530bb0 service nova] Creating event network-changed:7d0a5969-b1b9-44e1-be0d-aca6d57e8f28 for instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 on hv-cinder-85743 Sep 13 14:14:59.288037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-f12954df-db9f-4153-be36-17a718d8652f req-d2ca8566-b509-4f3c-914c-63c002530bb0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047525 Sep 13 14:14:59.289439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 198/384] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:14:59.311778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:59.313288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:59.341783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.341783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.341783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.341783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.342239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.342239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.521865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:59.531428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06f3ecda-d78b-43c9-b15d-6d66519a3ce3 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.223372 Sep 13 14:14:59.533000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 187/385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:59 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:59.716887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:59.718015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:59.726048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.726605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.727103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.727861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.728381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.728868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.814717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:59.815635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:59.823641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.824276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.824734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.825769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.826329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.826881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.882630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:14:59.893227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a08a278-57e8-45f2-bdad-40b23e2a6224 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.180446 Sep 13 14:14:59.901838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 199/386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:59 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:14:59.901838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:14:59.902132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:14:59.909928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.910420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.910991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:14:59.912424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:14:59.912910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:14:59.913338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.004452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.010154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.018446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7b4c64a-2ae6-4291-8c74-b70a4b1e9c98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1249 microversion: 2.1 time: 0.122891 Sep 13 14:15:00.019036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 200/387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1249 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:00.025513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9d0baecd-decd-467c-9252-c3791754771b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.209167 Sep 13 14:15:00.026346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 188/388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:14:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:00.111019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:00.111527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:00.118422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.118900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.119474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.120177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.120635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.121061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.177236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:00.177852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:00.186866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.187721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.189424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.190401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.191099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.191907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.293177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.301776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c2c2569-f42e-4b9f-b5a0-bcb342228a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.194412 Sep 13 14:15:00.314669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 201/389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:00.356789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.365308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.367523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.368931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-292f1250-b67b-4019-ac18-f3358c7e4dee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.196176 Sep 13 14:15:00.369501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 189/390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:00.559444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:00.560190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:00.567174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.567772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.568330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.569052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.569514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.569992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.719526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:00.730236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6042c561-49d9-4df3-8542-7937490f22dd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.176269 Sep 13 14:15:00.731295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 202/391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:00 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:00.919384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:00.920234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:00.927121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.927602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.928029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:00.928715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:00.929161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:00.929607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.041950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:01.043015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:01.051834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.052570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.053197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.054112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.054992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.055127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.088630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.098393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-849e9035-b2af-4b51-b2b8-8b3c67871004 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.185348 Sep 13 14:15:01.116296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 190/392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:00 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:01.121220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:01.121856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:01.129552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.130260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.130585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.131712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.132476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.132958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.137188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.147333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09c93ce2-3883-4091-bd6e-e4f71adffa88 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1249 microversion: 2.1 time: 0.109188 Sep 13 14:15:01.154672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 203/393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:01 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1249 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:01.286354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.296109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ce806754-c50a-4f2a-8014-32d8b6d0b4b4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.178593 Sep 13 14:15:01.296974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 191/394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:01.327182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:01.327829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:01.335326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.335901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.336426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.337213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.337903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.338526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.397304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:01.398231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:01.406922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.407624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.408694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.409801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.410268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.410690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.497357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.506890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eae06a58-8f50-47af-9cc3-419cb94879d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.183584 Sep 13 14:15:01.507746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 204/395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:01.756270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:01.756986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:01.765219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.766017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.768067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.768737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:01.769537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:01.770614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:01.921226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.946085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.947536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:01.948709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-277ac761-fa7b-4f98-9d70-609777941425 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.556240 Sep 13 14:15:01.949459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 192/396] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:02.125370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:02.126181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:02.135507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.138177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.144385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.146803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.149451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.150414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.152296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:02.166852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-682524a6-986c-48a6-9291-ebde751c2a85 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.415622 Sep 13 14:15:02.167640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 205/397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:01 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:02.174032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:02.174994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:02.183235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.183727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.184164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.184870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.185479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.185954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.294135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:02.318994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9ceaadc-bf29-4552-9f10-62173d03ce55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1297 microversion: 2.1 time: 0.150035 Sep 13 14:15:02.325088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 206/398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:02 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1297 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:02.331534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:02.332188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:02.338860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.365254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.367907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.367907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.370713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.375047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.451516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:02.464816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-07026376-dcfa-4d20-a6c8-e3ba0db68395 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.344516 Sep 13 14:15:02.475183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 193/399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:02 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:02.534508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:02.535642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:02.543041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.543772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.544372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.545296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.545777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.546416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.600347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:02.609610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0b70795-c61c-4d45-ae7b-701a9cfffb9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.282482 Sep 13 14:15:02.611068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 207/400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:02.708057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:02.718739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-085dfcbc-f9b0-42e9-bb14-47f8e6da87e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.189987 Sep 13 14:15:02.719537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 194/401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:02.975651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:02.976453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:02.983597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.983862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.984069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:02.984804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:02.985331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:02.987322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.125013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.133243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.134707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.135977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2420ef57-14a7-47ae-8cd7-1c3d14c6a05b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.164709 Sep 13 14:15:03.150288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 208/402] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:03.194350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:03.195246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:03.201588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.202084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.202512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.203197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.203672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.205181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.355018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.362132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:03.363443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:03.364422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3ad23155-da40-468d-ae16-9c7463480881 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.173896 Sep 13 14:15:03.370897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 195/403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:03 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:03.373700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.374682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.375425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.377202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.377850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.378279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.451538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.461018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-945f627f-553c-4aca-be46-b907235c0613 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1297 microversion: 2.1 time: 0.104102 Sep 13 14:15:03.462424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 209/404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1297 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:03.491347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:03.492732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:03.500027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.501057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.501832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.502897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.504003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.504687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.634771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:03.635745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:03.642702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.643323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.643761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.644668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.645706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.646312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.661749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.670708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f595f7c-dfbd-4ee5-a80f-6d4670073226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.184117 Sep 13 14:15:03.671721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 196/405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:03 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:03.741965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:03.742991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:03.749524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.750339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.751951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.753198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:03.754079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:03.754980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:03.845376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.852022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:03.857920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66f1bf44-40eb-4ef0-ab54-5208b014427a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.228618 Sep 13 14:15:03.862435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 210/406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:03.918465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:03.928751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-648e739c-235d-4b2e-8ba1-ee9009f5129b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.190838 Sep 13 14:15:03.930032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 197/407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:04.163175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:04.164057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:04.171389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.171981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.172502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.177659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.177659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.177659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.330471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:04.340161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:04.341870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:04.343055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-59b9d4fa-e8bd-4769-b44e-66bc2ee663da tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.184631 Sep 13 14:15:04.348203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 211/408] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:04.387614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:04.388168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:04.395295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.395803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.396242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.396946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.397405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.397859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.484569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:04.485256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:04.494551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.495533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.496176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.497435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.498633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.499254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.587464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:04.589392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:04.591562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:04.598595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4a2a3ca-c6e9-4b38-8e68-6e6ecd1bddfd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.214739 Sep 13 14:15:04.599753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 198/409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:04 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:04.604439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fb459c3-922e-401a-889e-52e885f2307a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1297 microversion: 2.1 time: 0.123537 Sep 13 14:15:04.605329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 212/410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1297 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:04.698484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:04.699492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:04.707286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.708039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.708471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.709196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.709645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.710251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.860893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:04.869537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4ba08f4a-f676-4459-a32a-a0ceb1443f5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.175517 Sep 13 14:15:04.870271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 199/411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:04 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:04.894916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:04.895782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:04.902345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.903117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.903555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.904358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.904971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.905551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.953290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:04.954512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:04.960828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.961742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.962210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:04.962910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:04.963364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:04.963785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.078351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.083693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:05.090847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcc096b2-99df-43e2-81d3-21c78c3863dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.200442 Sep 13 14:15:05.091617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 213/412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:05.119547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.128485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d75f94b1-3ed9-46e1-aee1-19fc370a1076 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.179909 Sep 13 14:15:05.134322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 200/413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:05.368738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:05.369258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:05.376853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.377513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.377968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.378678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.379240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.379658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.538268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.548684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.550356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.551718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4285a260-23d5-4ae3-bf7b-b0b8a5b70bd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.187200 Sep 13 14:15:05.565897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 214/414] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:05.623614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:05.625174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:05.627852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:05.628857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:05.632576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.633361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.634025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.635000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.635719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.636136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.636560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.636723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.637304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.638131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.638733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.639263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.711362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.722655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3549997-8df8-4081-a146-afeebcfc3558 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1297 microversion: 2.1 time: 0.098758 Sep 13 14:15:05.724837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 215/415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:05.862799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:05.872266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97e2dd32-bc25-4a96-8f4f-0ec9ee46f209 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.252815 Sep 13 14:15:05.873191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 201/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:05 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:05.895844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:05.896687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:05.903897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.904480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.904981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:05.905785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:05.906262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:05.906693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.086458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.100599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40aa20f9-8581-4f1b-ab40-5847cd1194d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.209960 Sep 13 14:15:06.101474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 216/417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:05 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:06.124525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:06.125264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:06.132496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.133095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.133601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.134419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.134945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.135438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.151948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:06.152485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:06.161358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.161869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.162302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.163003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.163443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.163862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.325539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.339104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0588be55-a915-4da7-a045-7c898b1d3b7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.219045 Sep 13 14:15:06.354457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 202/418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:06.449655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.458755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85631e68-2c2c-4743-9d45-6e718454973a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1358 microversion: 2.1 time: 0.310595 Sep 13 14:15:06.459534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 217/419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1358 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:06.580941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:06.581571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:06.591442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.592104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.592697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.593547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.594190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.594820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.751809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:06.753505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:06.760258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.761100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.761781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.762760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.763698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.768185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.771463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.782940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.785473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.804216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e92228d5-7dd3-4ec2-b46e-4257b3d97e36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.222377 Sep 13 14:15:06.805243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 203/420] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:06.883598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:06.893315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-027a4968-d933-40a2-af8e-a5a911f74661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1305 microversion: 2.1 time: 0.145874 Sep 13 14:15:06.894326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 218/421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:06 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1305 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:06.897258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:06.898009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:06.904668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.905489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.906123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:06.907937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:06.908690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:06.909300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.130183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.130605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:07.139520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.140079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.140656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.141989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.143054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.143743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.165659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.174088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc691ca0-3595-43c1-87b6-d8c2a9c95772 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.281464 Sep 13 14:15:07.174945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 204/422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:06 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:07.275429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.283770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec451625-3579-4279-9e3e-5594e787b58c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.158917 Sep 13 14:15:07.284341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 219/423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:07.372007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.372659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:07.379391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.379864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.380323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.381026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.381565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.382018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.484486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.485272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:07.491941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.492425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.492858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.493619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.494104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.494532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.511504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.520920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05857b49-a6cf-4121-b2bf-fa075333ebbe tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.152706 Sep 13 14:15:07.521680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 205/424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:07.631898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.640357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78f82b48-eda6-4428-a24e-9739ff891b36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1548 microversion: 2.1 time: 0.159896 Sep 13 14:15:07.640939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 220/425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:07.669124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.669748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:07.676076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.676550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.676977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.677655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.678127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.678548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.809831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.818516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c2ee5266-aa4f-4e95-94d4-960ef9e874ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1548 microversion: 2.1 time: 0.153058 Sep 13 14:15:07.819077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 206/426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:07.832478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.833185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:07.839567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.840060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.840499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.841187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.841457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.841631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.842123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.846820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.847619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Searching by: {'deleted': False, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978'} {{(pid=120642) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 14:15:07.854448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.854929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.855386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.856133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:07.856599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:07.857537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:07.951591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.multi_cell_list [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120642) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 14:15:07.978329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.987075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.988515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:07.989659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7427954-c441-475b-aa4e-c71ccadd2097 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.161311 Sep 13 14:15:07.990314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 221/427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:07.994802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:07.995438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:08.002178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.002665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.003100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.003792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.004246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.004675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.052792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e285c650-d49c-4137-b93f-7bd6547034af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215082 Sep 13 14:15:08.053377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 207/428] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:15:08.068573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:08.072755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:08.073507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:08.076388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-051685e0-1642-450e-8d4a-3b6ccc244230 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1303 microversion: 2.1 time: 0.084952 Sep 13 14:15:08.076957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 222/429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:08.079537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.080014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.080446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.081127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.081575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.082030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.196658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:08.197264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:08.203159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.203761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.204144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.204818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.205271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.205698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.214510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:08.222935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-caae2dcf-2c3e-4354-a391-d290963f0284 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1548 microversion: 2.1 time: 0.154020 Sep 13 14:15:08.223492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 208/430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:08.243529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:08.306504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:08.307212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:08.313149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.313710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.314323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.315463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.316195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.316605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.341786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:08.351257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94b973cc-6ccc-49ad-9cad-ba0e5b912b5d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.158588 Sep 13 14:15:08.352194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 223/431] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:08 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:08.462408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:08.471251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ebc9a642-d8b4-4476-8c10-e74779c53c50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.168767 Sep 13 14:15:08.471831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 209/432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:08 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:08.545205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:08.546058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:08.553925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.554567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.555056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.555856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:08.556367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:08.556840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:08.689692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:08.698048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5977d0aa-b590-4df8-a71b-847c6dd4df75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.157852 Sep 13 14:15:08.698935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 224/433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:09.016010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:09.017019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:09.023928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.024416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.024848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.025609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.026101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.026528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.101321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:09.101966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:09.103817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=14 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:09.109096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.109591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.110868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.111591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.112053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.112483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.155812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.165028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.166679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.167899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-539ffefc-4f00-46cd-9eee-0c4d52dde73e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.155832 Sep 13 14:15:09.168582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 210/434] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:09.175639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.183415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4104d915-53bb-4291-8812-7e0fbe2249cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1303 microversion: 2.1 time: 0.086094 Sep 13 14:15:09.183972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 225/435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:09 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:09.374682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:09.375282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:09.381893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.382399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.382828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.383535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.383991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.384508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.493934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:09.494592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:09.500993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.501316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.501779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.502479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.502936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.503382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.521842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.528927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dd982ca1-85e2-463c-9fd6-9334138ba29e tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.157931 Sep 13 14:15:09.530756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 211/436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:09 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:09.642022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.649916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bccfd584-f4bb-403c-afdc-451acaa9e769 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.160023 Sep 13 14:15:09.650479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 226/437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:09 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:09.722541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:09.723079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:09.728923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.729420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.729885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.730654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:09.731106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:09.731522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:09.861848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:09.870390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ff2e7bb1-75a4-49bf-ac14-8154913613b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.151732 Sep 13 14:15:09.871028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 212/438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:10.195046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:10.195664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:10.202698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.203377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.204044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.205068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.205530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.206020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.208056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:10.208662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:10.214842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.215311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.215734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.216411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.216858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.217273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.280555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:10.288457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb009ca0-aedc-4544-9059-57f10c9bcb6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1303 microversion: 2.1 time: 0.084068 Sep 13 14:15:10.293766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 213/439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:10.340357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:10.350564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:10.352203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:10.353423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcec11bd-8491-404f-a642-a2b9a9bd9105 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.162763 Sep 13 14:15:10.354075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 227/440] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:10.552986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:10.553796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:10.559884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.560376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.560851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.561525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.562004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.562420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.672111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:10.672860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:10.679157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.679637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.680067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.680757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.681208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.681627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.697962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:10.706646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dd5c8ab2-f990-4439-8812-49959530e526 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.157550 Sep 13 14:15:10.707242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 214/441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:10 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:10.815221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:10.823635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86dcb2fe-8604-4d70-ab19-dedbeb35e625 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.155161 Sep 13 14:15:10.824253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 228/442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:10 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:10.895946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:10.896658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:10.902465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.903039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.903535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.904290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.904800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.905287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.910081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:10.928794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-2be4e06e-a57b-4f51-aba1-8fcd39cdc80e req-ec1396da-2003-4dfe-8198-441c97e24fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef415f6-4a45-42df-8fbf-07aaec2d0cf6", "name": "network-vif-plugged", "status": "completed", "tag": "08756683-d264-47b7-80d4-fa876fa95cd9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:10.945452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2be4e06e-a57b-4f51-aba1-8fcd39cdc80e req-ec1396da-2003-4dfe-8198-441c97e24fe2 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:10.945938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2be4e06e-a57b-4f51-aba1-8fcd39cdc80e req-ec1396da-2003-4dfe-8198-441c97e24fe2 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:10.946372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-2be4e06e-a57b-4f51-aba1-8fcd39cdc80e req-ec1396da-2003-4dfe-8198-441c97e24fe2 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:10.962466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-2be4e06e-a57b-4f51-aba1-8fcd39cdc80e req-ec1396da-2003-4dfe-8198-441c97e24fe2 service nova] Creating event network-vif-plugged:08756683-d264-47b7-80d4-fa876fa95cd9 for instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 on hv-cinder-85743 Sep 13 14:15:10.968067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-2be4e06e-a57b-4f51-aba1-8fcd39cdc80e req-ec1396da-2003-4dfe-8198-441c97e24fe2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044050 Sep 13 14:15:10.968675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 229/443] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:11.044701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:11.053416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-27a68bd6-40b4-499f-b91d-bea3a05876d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.162285 Sep 13 14:15:11.054012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 215/444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:11.312343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:11.313794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:11.320026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.320501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.320934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.321614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.322101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.322523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.379536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:11.380145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:11.383937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:11.386442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.386924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.387357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.388049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.388504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.388924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.392975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d621e8d7-9579-4952-8c76-57bf643c96ff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1303 microversion: 2.1 time: 0.084798 Sep 13 14:15:11.393624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 230/445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:11.515148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:11.523660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:11.525107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:11.527180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ebda89a9-d38e-4b8e-a4f3-f335f213ae06 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.151385 Sep 13 14:15:11.527180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 216/446] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:11.730416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:11.731029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:11.738350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.738832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.739261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.739946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.740400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.740825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.744969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:11.849169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:11.849935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:11.855976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.857068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.857833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.859423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.859423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.859596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.872341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:11.880560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0491f211-5ffd-4ea1-bd8f-469ec3f28627 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.153930 Sep 13 14:15:11.881448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 231/447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:11 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:11.927029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d529c02d-aec4-4c38-85be-cf364eeb2bd6"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:11.929443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:11.936150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.936553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.937157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:11.938325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:11.938978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:11.939502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.046514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:12.056269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88e2ed80-e085-4bf7-a476-c75b4aa3dc47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.211786 Sep 13 14:15:12.056845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 217/448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:11 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:12.078670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:12.079753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:12.089683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.090210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.090649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.091357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.091816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.092244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.260996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:12.274855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a697cf3d-c6f1-40be-81f8-40f4ea2d7adf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1724 microversion: 2.1 time: 0.200541 Sep 13 14:15:12.275435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 218/449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:12.416064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:12.416793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:12.424344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.424835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.425266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.425980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.426890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.427592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.507883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:12.517855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89ff15b3-2372-4f71-9bcb-73ad9aadd873 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1303 microversion: 2.1 time: 0.105722 Sep 13 14:15:12.518911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 219/450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:12.552628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:12.553310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:12.559527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.560017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.560540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.561328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.561808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.562255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.582070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-632759e5-0b92-4518-94a4-c321bd5c2182 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.659354 Sep 13 14:15:12.582857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 232/451] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:15:11 2022] POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:15:12.760048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:12.774342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:12.776424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:12.778156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b5bc2da-91bb-40c2-8697-7ec014137b4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1739 microversion: 2.20 time: 0.230279 Sep 13 14:15:12.779286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 220/452] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:12.904005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:12.904706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:12.912967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.913446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.913910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:12.914603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:12.915054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:12.915475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.046024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:13.053913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4269a251-2bff-42b0-9ca9-db3a9a8bc150 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.154223 Sep 13 14:15:13.054477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 233/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:12 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:13.079992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:13.080784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:13.088740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.089647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.091923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.092685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.093153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.093573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.304514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:13.305394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:13.312778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.314212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.314724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.315502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.316049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.316554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.322530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:13.330795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9988624-c844-44b5-884b-1625e7759bcf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.255453 Sep 13 14:15:13.331693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 221/454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:13 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:13.515233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:13.525239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da7d61f6-64bb-48d3-bdc0-de130e837dac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1701 microversion: 2.1 time: 0.224516 Sep 13 14:15:13.526283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 234/455] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1701 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:13.542451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:13.543705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:13.552426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.553175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.553999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.554861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5303c2a5-005d-4765-873a-ac6d3e92ef79 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:13.555007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.555378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.555807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.561644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5303c2a5-005d-4765-873a-ac6d3e92ef79 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.562173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5303c2a5-005d-4765-873a-ac6d3e92ef79 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.562670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5303c2a5-005d-4765-873a-ac6d3e92ef79 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.635885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5303c2a5-005d-4765-873a-ac6d3e92ef79 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Going to try to start instance {{(pid=120643) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 14:15:13.706924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5303c2a5-005d-4765-873a-ac6d3e92ef79 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/action" status: 202 len: 0 microversion: 2.1 time: 0.155847 Sep 13 14:15:13.708635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 235/456] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:15:13 2022] POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 14:15:13.718364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:13.725366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:13.726328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:13.728292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ae21a0ee-83dd-42c6-bd7d-07a77346a80f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.190623 Sep 13 14:15:13.728981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 222/457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:13 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:13.734496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.735698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.736429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.737252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.737716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.738170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.805601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:13.806735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:13.814249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.815066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.815719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.816825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:13.817499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:13.818179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:13.994983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:14.005032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d02c3bc-fd4e-4262-8bf8-3b2ba0c5dd4f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1710 microversion: 2.1 time: 0.291244 Sep 13 14:15:14.009320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 236/458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1710 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:14.014033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:14.027036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:14.029038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:14.030443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-539339f3-c001-4f6f-9cde-9fce764515e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1721 microversion: 2.20 time: 0.229883 Sep 13 14:15:14.031127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 223/459] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:14.075305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:14.076205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:14.082942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.083651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.084090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:14.084792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.085253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.085681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:14.109531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-f5520bde-1fa7-48bd-93b1-3a9422181148 req-b4f8f935-c178-4049-aad1-06b8eda2911e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f1a1a8-03b2-4087-a62a-885a432f4852", "tag": "5b53af25-2b95-41ce-9f86-e80d09df687e"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:14.119329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-f5520bde-1fa7-48bd-93b1-3a9422181148 req-b4f8f935-c178-4049-aad1-06b8eda2911e service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.119858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-f5520bde-1fa7-48bd-93b1-3a9422181148 req-b4f8f935-c178-4049-aad1-06b8eda2911e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.120283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-f5520bde-1fa7-48bd-93b1-3a9422181148 req-b4f8f935-c178-4049-aad1-06b8eda2911e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:14.133352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-f5520bde-1fa7-48bd-93b1-3a9422181148 req-b4f8f935-c178-4049-aad1-06b8eda2911e service nova] Creating event network-changed:5b53af25-2b95-41ce-9f86-e80d09df687e for instance 75f1a1a8-03b2-4087-a62a-885a432f4852 on hv-cinder-85743 Sep 13 14:15:14.139881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-f5520bde-1fa7-48bd-93b1-3a9422181148 req-b4f8f935-c178-4049-aad1-06b8eda2911e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033766 Sep 13 14:15:14.140974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 224/460] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:15:14.267124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:14.275366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50892d3b-429f-4f99-8eec-bbc30b0ad6d7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.203829 Sep 13 14:15:14.276064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 237/461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:14 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:14.355429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:14.356118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:14.362570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.363049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.363479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:14.364164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.364612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.365026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:14.495128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:14.503707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee4ca0b9-bbc0-4a1c-95e2-54e3a0bb2c02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1365 microversion: 2.1 time: 0.152368 Sep 13 14:15:14.504267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 225/462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:14 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:14.754838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:14.755448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:14.772666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.773180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.773581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:14.774311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:14.774942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:14.775523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.032738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:15.033346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:15.040009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.040854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.041144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.041875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.042334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.042764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.178165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.186528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-36925f10-ddb9-4ada-a0fb-437b8db68e44 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1710 microversion: 2.1 time: 0.157849 Sep 13 14:15:15.196964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 226/463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:15.196964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:15.196964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:15.198385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.198862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.199462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.200342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.200796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.201213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.248154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.255848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b766bd52-7cd2-4294-8d38-3f9f2ec5d157 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.505364 Sep 13 14:15:15.256408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 238/464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:14 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:15.299075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:15.299731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:15.305627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.306141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.306606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.307300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.307823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.308250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.336775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.346299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.347473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.348629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33aba322-1d26-4010-bb97-613d0ff9409d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1721 microversion: 2.20 time: 0.160647 Sep 13 14:15:15.365372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 227/465] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:15.371285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:15.371285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:15.378178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.378666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.379257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.380454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.380910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.381698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.440721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.448983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acd0adbd-2461-44ff-b608-c3ebd83d4cf7 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.153801 Sep 13 14:15:15.449924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 239/466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:15 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:15.513339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lazy-loading 'services' on Instance uuid 6cb9652a-f075-48fa-8725-baf081ae174b {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:15:15.530443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:15.531163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:15.537850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.538332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.538763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.539545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.539996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.540412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.629474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ffdccf6c-b13c-4c53-bca7-16266b34a3e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b/os-volume_attachments/e6757c48-affb-4f74-bab3-d58a5bc3ac78" status: 202 len: 0 microversion: 2.1 time: 0.262428 Sep 13 14:15:15.630124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 228/467] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 13 14:15:15 2022] DELETE /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b/os-volume_attachments/e6757c48-affb-4f74-bab3-d58a5bc3ac78 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:15:15.673235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:15.681414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6ce02f1-8c77-4fc4-87b3-eaaf39a2895e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1555 microversion: 2.1 time: 0.156882 Sep 13 14:15:15.682081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 240/468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:15 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:15.705954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:15.706530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:15.712602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.713081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.713511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.714225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:15.714680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:15.715102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:15.791683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ce8699d0-293a-4377-a85d-a8ca722b288b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090533 Sep 13 14:15:15.792297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 229/469] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:15:15 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:16.211297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:16.211914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:16.218355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.218839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.219304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.220284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.220747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.221179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.281078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:16.281788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:16.289958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.290653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.291082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.291773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.292216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.292858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.358927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:16.369992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8efea75f-0a1d-4b70-91ed-341e16a983ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1710 microversion: 2.1 time: 0.161590 Sep 13 14:15:16.370315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 241/470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:16.375949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:16.376654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:16.382728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.383157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.383597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.384662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.384916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.385446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.541416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:16.550977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-13ca1fac-e65e-42c6-836c-b0061a87e6c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.274410 Sep 13 14:15:16.565418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 230/471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:16 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:16.565418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:16.565418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:16.565418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.565418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.566299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.568700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.569357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.570082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:16.775332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:16.778628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:16.789320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:16.795331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:16.796558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d415d6df-056d-4252-9f87-e3b5fe7cb720 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1721 microversion: 2.20 time: 0.425025 Sep 13 14:15:16.797169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 242/472] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:16.810465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fe24cd80-8595-4b46-a9fd-a2371ae3e705 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.244525 Sep 13 14:15:16.819180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 231/473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:16 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:16.979096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-187ff926-209b-44bb-8b1c-8c39b7085845 req-159ad148-5635-4b50-b235-2f9307e5d384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef415f6-4a45-42df-8fbf-07aaec2d0cf6", "tag": "08756683-d264-47b7-80d4-fa876fa95cd9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:16.995943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-187ff926-209b-44bb-8b1c-8c39b7085845 req-159ad148-5635-4b50-b235-2f9307e5d384 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:16.996427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-187ff926-209b-44bb-8b1c-8c39b7085845 req-159ad148-5635-4b50-b235-2f9307e5d384 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:16.996856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-187ff926-209b-44bb-8b1c-8c39b7085845 req-159ad148-5635-4b50-b235-2f9307e5d384 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.009820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-187ff926-209b-44bb-8b1c-8c39b7085845 req-159ad148-5635-4b50-b235-2f9307e5d384 service nova] Creating event network-changed:08756683-d264-47b7-80d4-fa876fa95cd9 for instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 on hv-cinder-85743 Sep 13 14:15:17.015579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-187ff926-209b-44bb-8b1c-8c39b7085845 req-159ad148-5635-4b50-b235-2f9307e5d384 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041118 Sep 13 14:15:17.016824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 243/474] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:17.066191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-06f39f6e-45e6-43af-9a80-8766733b483e req-88ec6045-e9c1-4338-bbec-1d269ea1a8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2fd805-47b4-4a80-b6b9-59570b95d010", "name": "network-vif-plugged", "status": "completed", "tag": "7d0a5969-b1b9-44e1-be0d-aca6d57e8f28"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:17.084777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-06f39f6e-45e6-43af-9a80-8766733b483e req-88ec6045-e9c1-4338-bbec-1d269ea1a8bc service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.085864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-06f39f6e-45e6-43af-9a80-8766733b483e req-88ec6045-e9c1-4338-bbec-1d269ea1a8bc service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.086503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-06f39f6e-45e6-43af-9a80-8766733b483e req-88ec6045-e9c1-4338-bbec-1d269ea1a8bc service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.098289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:17.101414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-06f39f6e-45e6-43af-9a80-8766733b483e req-88ec6045-e9c1-4338-bbec-1d269ea1a8bc service nova] Creating event network-vif-plugged:7d0a5969-b1b9-44e1-be0d-aca6d57e8f28 for instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 on hv-cinder-85743 Sep 13 14:15:17.108660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-06f39f6e-45e6-43af-9a80-8766733b483e req-88ec6045-e9c1-4338-bbec-1d269ea1a8bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046403 Sep 13 14:15:17.110568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 232/475] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:17.392862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:17.393583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:17.401872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.402358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.402813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.403493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.403948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.404368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.580046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:17.580914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:17.593965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.597030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.597588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.598582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.600432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.601032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.650660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:17.661636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9bc7394a-f3a4-466c-ac3f-6293fcaebcd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1710 microversion: 2.1 time: 0.273661 Sep 13 14:15:17.663121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 244/476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1710 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:17.772566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:17.780948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ecdaee0f-1b13-4848-a9cf-d551b74fae18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.207277 Sep 13 14:15:17.781805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 233/477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:17.826718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:17.827328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:17.838388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.846853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:17.847713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:17.856733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.857996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.858935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.862174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.864007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.870397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.876304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.876891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.877715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:17.878663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:17.880470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:17.893884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:18.095520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.104684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5421a137-46cf-465c-99dc-b03503f943f9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.264559 Sep 13 14:15:18.105276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 234/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:17 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:18.115330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.123687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.125122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.126348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6df0a1b-c00f-43cb-9fc3-6d825a6f26d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1664 microversion: 2.20 time: 0.303893 Sep 13 14:15:18.126908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 245/479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1664 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:18.151446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebee67b3-c11d-4ecf-8a7d-0a938eae31c9"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:18.153946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:18.155941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:18.162044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.162607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.163049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.163766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.164194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.164609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.504461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-570a6bd1-e9c7-46d6-bef7-c5838caf15bc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.357179 Sep 13 14:15:18.505071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 235/480] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Sep 13 14:15:18 2022] POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:15:18.631420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:18.632138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:18.638783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.639269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.639703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.640391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.641550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.642021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.646079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:18.685752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:18.686375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:18.688408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120643) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 14:15:18.693715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.694226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.694652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.695334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.695783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.696200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.698220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:18.760016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0373f0a-d9c0-4114-bbe7-fb329e6231d5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/action" status: 202 len: 0 microversion: 2.20 time: 0.132351 Sep 13 14:15:18.760638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 246/481] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 13 14:15:18 2022] POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:15:18.770151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:18.770773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:18.777223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.777742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.778202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.779360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.779360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.779790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.832695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.840901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-380970a5-bbb9-4e5c-b5df-4ba9170045e4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1714 microversion: 2.1 time: 0.158993 Sep 13 14:15:18.841462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 236/482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:18.850193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:18.850816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:18.858282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.858765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.859193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.859959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:18.860415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:18.860832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:18.927001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.936569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.938584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:18.940524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90687d52-0d4a-4cfe-ab2e-b616d77f3934 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1750 microversion: 2.20 time: 0.175565 Sep 13 14:15:18.950592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 247/483] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:19.031458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:19.039203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-132d7eab-fbb5-4691-9931-9e1a7dcd8b78 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.196612 Sep 13 14:15:19.039780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 237/484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:19.129289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:19.129986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:19.141449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:19.143057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:19.143609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:19.144742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:19.145310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:19.145874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:19.155298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-bc61d92e-f060-4d34-8186-4f9fef541993 req-af503ade-2dd3-4259-a924-ce75217eb7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "name": "network-vif-unplugged", "status": "completed", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:19.165293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-bc61d92e-f060-4d34-8186-4f9fef541993 req-af503ade-2dd3-4259-a924-ce75217eb7ee service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:19.165919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-bc61d92e-f060-4d34-8186-4f9fef541993 req-af503ade-2dd3-4259-a924-ce75217eb7ee service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:19.166535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-bc61d92e-f060-4d34-8186-4f9fef541993 req-af503ade-2dd3-4259-a924-ce75217eb7ee service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:19.178983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.compute.server_external_events [req-bc61d92e-f060-4d34-8186-4f9fef541993 req-af503ade-2dd3-4259-a924-ce75217eb7ee service nova] Unable to find a host for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b. Dropping event network-vif-unplugged {{(pid=120642) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 14:15:19.179930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-bc61d92e-f060-4d34-8186-4f9fef541993 req-af503ade-2dd3-4259-a924-ce75217eb7ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028373 Sep 13 14:15:19.180879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 238/485] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 13 14:15:19.298457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:19.306562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02d0e81f-9761-4da8-aa7c-6aaf344fb267 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.182599 Sep 13 14:15:19.307074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 248/486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:19 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:19.966986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:19.967632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:19.974073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:19.974544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:19.974969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:19.975642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:19.976086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:19.976499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:20.063549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:20.064326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:20.070898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:20.071383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:20.071812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:20.072500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:20.072951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:20.073372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:20.115010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:20.124245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:20.125705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:20.126887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f67b0f94-d1f2-44ef-97ac-34a24d020fd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1750 microversion: 2.20 time: 0.163814 Sep 13 14:15:20.127449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 239/487] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:20.204406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:20.211906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-758eb96c-2da0-4214-8319-67034960852c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.152871 Sep 13 14:15:20.212460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 249/488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:20 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:20.330476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:20.331084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:20.336927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:20.337409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:20.337885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:20.338569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:20.339022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:20.339444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:20.475203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:20.482755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3ad2a033-3d36-47bd-b4cb-335ca221ddb1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1314 microversion: 2.1 time: 0.156297 Sep 13 14:15:20.483315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 240/489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:20 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:21.151808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:21.152350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:21.159440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:21.159938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:21.160371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:21.161064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:21.161525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:21.161981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:21.236797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:21.238355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:21.246602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:21.247487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:21.248388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:21.249348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:21.250064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:21.250903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:21.332661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:21.341855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:21.343433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:21.345306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3105c68d-d3d3-4b5e-b76d-4c022fb8f10d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1750 microversion: 2.20 time: 0.197426 Sep 13 14:15:21.345932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 250/490] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:21.421243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:21.429649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-84dc7bc1-546d-43d5-a896-8a9a56808e82 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.196193 Sep 13 14:15:21.429649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 241/491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:21 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:21.504938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:21.505546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:21.511586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:21.512066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:21.512500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:21.513191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:21.513646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:21.514098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:21.644464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:21.652325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-282411cd-9b68-4fe4-9635-1aa7724037b1 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1498 microversion: 2.1 time: 0.151318 Sep 13 14:15:21.652897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 251/492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:21 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1498 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:22.116317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:22.116847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:22.122828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.123316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.123752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.124448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.124904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.126049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.151707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:15:22.224855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cad5ac7e-70b1-4371-a9e4-87fdfe86b13d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 204 len: 0 microversion: 2.1 time: 0.112124 Sep 13 14:15:22.225430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 242/493] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:15:22 2022] DELETE /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:15:22.233629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:22.234336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:22.241258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.241748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.242196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.242873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.243320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.243740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.371749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:22.372713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:22.385928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.386917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.387804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.388919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.389541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.390222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.406950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:22.415150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-61d643cf-5366-494e-a7db-de3ceefb40d2 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1504 microversion: 2.1 time: 0.185442 Sep 13 14:15:22.415732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 252/494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:22 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:22.452419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:22.453020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:22.459114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.459596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.460028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.461350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:22.461350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:22.461592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:22.551578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:22.560399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:22.562001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:22.563315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3b0b81ef-913f-47e9-834f-dd720b6680dd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.196413 Sep 13 14:15:22.564174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 243/495] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:22.596149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:22.603889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a68f587a-3208-4edb-8d29-67e063d2206b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.155193 Sep 13 14:15:22.604448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 253/496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:22 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:23.439901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:23.440518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:23.446904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:23.447387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:23.447828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:23.448520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:23.448979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:23.449404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:23.588814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:23.589432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:23.591457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:23.596194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:23.596916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:23.597109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:23.597840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:23.598301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:23.598729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:23.599648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ceb73fe-cab5-4062-8b1f-15517908e9fd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1504 microversion: 2.1 time: 0.164106 Sep 13 14:15:23.600536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 244/497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:23 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:23.628551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:23.629414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:23.636554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:23.637173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:23.637712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:23.638556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:23.639112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:23.639715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:23.746944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:23.756990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:23.758468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:23.759633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c201e9f-c2ed-4b0b-b4b0-50b6adfd255d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.175075 Sep 13 14:15:23.760194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 254/498] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:23.784508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:23.788166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:23.793440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30f7a209-dd6c-4a46-9638-cacc885736e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.170153 Sep 13 14:15:23.794026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 245/499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:23 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:24.622530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:24.623136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:24.630134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.630618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.631225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.631921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.632382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.632806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.643711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:24.644315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:24.652721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.653192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.653613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.654317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.654767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.655185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.766445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:24.774459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19de21fc-8dc0-4b36-90f7-b6ff21589198 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1504 microversion: 2.1 time: 0.155652 Sep 13 14:15:24.775040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 255/500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:24 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:24.792047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:24.793123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:24.793776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:24.800024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.800410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-50b1571b-a53a-44f3-8d4b-3bb8b24edfd1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1594 microversion: 2.1 time: 0.161068 Sep 13 14:15:24.800513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.800926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.801021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 246/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:24.801646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.802116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.802542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.818565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:24.818703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:24.824852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.825455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.825988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.826771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:24.827297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:24.828175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:24.996640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:25.006591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:25.008628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:25.010047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-328c2f5d-6a45-46af-91d6-93d6fd98ef8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.228551 Sep 13 14:15:25.010619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 256/502] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:25.115041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-3ffce452-fe46-4461-8753-1be69397f010 req-34dba949-53a5-48ea-ae18-f860e0c4303d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f1a1a8-03b2-4087-a62a-885a432f4852", "name": "network-vif-plugged", "status": "completed", "tag": "5b53af25-2b95-41ce-9f86-e80d09df687e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:25.132000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3ffce452-fe46-4461-8753-1be69397f010 req-34dba949-53a5-48ea-ae18-f860e0c4303d service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:25.133224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3ffce452-fe46-4461-8753-1be69397f010 req-34dba949-53a5-48ea-ae18-f860e0c4303d service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:25.133648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-3ffce452-fe46-4461-8753-1be69397f010 req-34dba949-53a5-48ea-ae18-f860e0c4303d service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:25.143949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:25.156668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-3ffce452-fe46-4461-8753-1be69397f010 req-34dba949-53a5-48ea-ae18-f860e0c4303d service nova] Creating event network-vif-plugged:5b53af25-2b95-41ce-9f86-e80d09df687e for instance 75f1a1a8-03b2-4087-a62a-885a432f4852 on hv-cinder-85743 Sep 13 14:15:25.159120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8e9ea5a8-e20b-4139-a53a-8f4560156b8c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.344918 Sep 13 14:15:25.163896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 247/503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:25.165982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-3ffce452-fe46-4461-8753-1be69397f010 req-34dba949-53a5-48ea-ae18-f860e0c4303d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054763 Sep 13 14:15:25.166757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 257/504] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:15:25.652952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-0712e55f-6337-4caa-8bf9-9463d595836b req-15da0312-c4b2-48e0-a718-f0da482a8767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2fd805-47b4-4a80-b6b9-59570b95d010", "name": "network-vif-deleted", "tag": "7d0a5969-b1b9-44e1-be0d-aca6d57e8f28"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:25.663041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0712e55f-6337-4caa-8bf9-9463d595836b req-15da0312-c4b2-48e0-a718-f0da482a8767 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:25.663518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0712e55f-6337-4caa-8bf9-9463d595836b req-15da0312-c4b2-48e0-a718-f0da482a8767 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:25.663945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-0712e55f-6337-4caa-8bf9-9463d595836b req-15da0312-c4b2-48e0-a718-f0da482a8767 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:25.677091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-0712e55f-6337-4caa-8bf9-9463d595836b req-15da0312-c4b2-48e0-a718-f0da482a8767 service nova] Creating event network-vif-deleted:7d0a5969-b1b9-44e1-be0d-aca6d57e8f28 for instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 on hv-cinder-85743 Sep 13 14:15:25.682454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-0712e55f-6337-4caa-8bf9-9463d595836b req-15da0312-c4b2-48e0-a718-f0da482a8767 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033059 Sep 13 14:15:25.683228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 248/505] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:25.799938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:25.800757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:25.827396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:25.827823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:25.828920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:25.829633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:25.835307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:25.835767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:25.917423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:25.925420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd8f6838-3f23-4bf2-815c-8aa9dcaaeb25 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1299 microversion: 2.1 time: 0.131218 Sep 13 14:15:25.926045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 258/506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:25 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:26.037670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:26.038400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:26.044401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.044884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.045317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.046062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.046524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.046989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.191264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:26.191880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:26.198234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.208031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.208499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.208999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:26.209251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.209717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.210170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.219541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:26.221327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:26.222682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-98093aa1-9873-489b-92cb-fe7e68ca52f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.189279 Sep 13 14:15:26.223402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 249/507] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:26.471752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:26.481333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2504b0f8-6396-428d-9825-38159bffd363 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.294655 Sep 13 14:15:26.497902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 259/508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:26 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:26.510878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:26.511626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:26.517643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.518159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.518588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.519271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.519717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.520402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.547384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:15:26.627832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-31a90d3b-76ea-4cf7-b4b8-74a47876e6e3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 204 len: 0 microversion: 2.1 time: 0.120451 Sep 13 14:15:26.629027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 250/509] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:15:26 2022] DELETE /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:15:26.636682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:26.637378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:26.643593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.644222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.645076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.645890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.646409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.646936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.948860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:26.949593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:26.956500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.956977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.957409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.958127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.958578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.958990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.992894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:26.993372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:26.993824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:26.994267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lazy-loading 'fault' on Instance uuid 0f2fd805-47b4-4a80-b6b9-59570b95d010 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:15:27.037472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:27.045330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-07b784e4-223d-44df-8cba-aae2240e22c0 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1304 microversion: 2.1 time: 0.100662 Sep 13 14:15:27.045924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 251/510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:26 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:27.163749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:27.171304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e870db29-1fd0-41a3-a116-4ea0cf66a28d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1515 microversion: 2.1 time: 0.538558 Sep 13 14:15:27.172833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 260/511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:26 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:27.256504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:27.257156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:27.262936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:27.263421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:27.263833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:27.264503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:27.264951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:27.265365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:27.395547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:27.404098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:27.405553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:27.407325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c8450a4f-d434-4d79-9a61-30570491fa58 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.154733 Sep 13 14:15:27.408109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 252/512] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:27.467518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e6a09410-b0a0-4152-ba66-272e570128bf req-aa3f14cf-3500-4b0d-ba5d-2d4222d25137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:27.478116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e6a09410-b0a0-4152-ba66-272e570128bf req-aa3f14cf-3500-4b0d-ba5d-2d4222d25137 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:27.478593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e6a09410-b0a0-4152-ba66-272e570128bf req-aa3f14cf-3500-4b0d-ba5d-2d4222d25137 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:27.479336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e6a09410-b0a0-4152-ba66-272e570128bf req-aa3f14cf-3500-4b0d-ba5d-2d4222d25137 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:27.492758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e6a09410-b0a0-4152-ba66-272e570128bf req-aa3f14cf-3500-4b0d-ba5d-2d4222d25137 service nova] Creating event network-changed:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:15:27.498452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e6a09410-b0a0-4152-ba66-272e570128bf req-aa3f14cf-3500-4b0d-ba5d-2d4222d25137 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034307 Sep 13 14:15:27.499652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 261/513] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:27.506239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:27.507082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:27.513329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:27.514195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:27.514628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:27.516187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:27.516789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:27.517281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:27.716679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:27.727712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4fc7eac1-f2be-4575-91e0-3a40501d7f74 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1370 microversion: 2.1 time: 0.225980 Sep 13 14:15:27.738040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 253/514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:27 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:28.070306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:28.071007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:28.086128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.086637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.087290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.088521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.089171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.090110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.127622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.128146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.128579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.129033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lazy-loading 'fault' on Instance uuid 0f2fd805-47b4-4a80-b6b9-59570b95d010 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:15:28.194239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:28.198570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:28.200252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:28.201801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:28.206406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6186dee5-7833-4d2c-91f0-b168c83c185c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1304 microversion: 2.1 time: 0.140707 Sep 13 14:15:28.207321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 262/515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:28 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:28.210425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.210982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.211499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.212282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.212948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.213431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.380981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:28.396824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef0d7056-29ba-4239-9169-448487357c8b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1515 microversion: 2.1 time: 0.205401 Sep 13 14:15:28.397534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 254/516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:28 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:28.434619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:28.435379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:28.444111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.444813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.445344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.446329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.446870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.447356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.602106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:28.619215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:28.620746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:28.622197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42b63014-2000-4a41-9a2b-a780e2c4a662 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.192855 Sep 13 14:15:28.622836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 263/517] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:28.623476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-429714885"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:28.623974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:28.630305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.630841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.631273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.631990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.632435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.632851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.767275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:28.767916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:28.771654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.network.security_group_api [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Adding security group 37f15c7f-6e71-4d0e-89f9-da4041c2d7a7 to port 974f489a-92d3-4fbf-bb59-7a9a63bf7378 Sep 13 14:15:28.774477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.774965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.775402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.776095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.776559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.777089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.911707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:28.919434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0c0c10a-903e-4cdf-93c9-53ce1d68aeac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1563 microversion: 2.1 time: 0.156761 Sep 13 14:15:28.920010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 264/518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:28 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:28.941264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:28.941818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:28.947603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.948077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.948506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:28.949190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:28.949641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:28.950085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.027428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-802cfc37-c2fe-4f20-9a30-a9398b46db80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089862 Sep 13 14:15:29.028113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 265/519] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:15:28 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:15:29.096212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19f3fdc9-4e54-41a6-a6fd-f1683fadec5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action" status: 202 len: 0 microversion: 2.1 time: 0.476691 Sep 13 14:15:29.097026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 255/520] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:15:28 2022] POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 14:15:29.106831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:29.107636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:29.114067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.114754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.115355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.116048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.116718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.117307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.133336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-eeb5edf6-9a67-4eb9-8627-80e4f7d28428 req-c6452416-9f46-4e86-97b0-39b52e115f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:29.156278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-eeb5edf6-9a67-4eb9-8627-80e4f7d28428 req-c6452416-9f46-4e86-97b0-39b52e115f48 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.156764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-eeb5edf6-9a67-4eb9-8627-80e4f7d28428 req-c6452416-9f46-4e86-97b0-39b52e115f48 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.157189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-eeb5edf6-9a67-4eb9-8627-80e4f7d28428 req-c6452416-9f46-4e86-97b0-39b52e115f48 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.183061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-eeb5edf6-9a67-4eb9-8627-80e4f7d28428 req-c6452416-9f46-4e86-97b0-39b52e115f48 service nova] Creating event network-changed:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:15:29.189219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-eeb5edf6-9a67-4eb9-8627-80e4f7d28428 req-c6452416-9f46-4e86-97b0-39b52e115f48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064376 Sep 13 14:15:29.190375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 256/521] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:29.229546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:29.230403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:29.243337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.243981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.244484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.245248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.246052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.246923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.295436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.296080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.297458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.299146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lazy-loading 'fault' on Instance uuid 0f2fd805-47b4-4a80-b6b9-59570b95d010 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:15:29.360523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:29.376680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8589732-bda0-46d0-8458-b1d24cf7e2ff tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 200 len: 1304 microversion: 2.1 time: 0.151855 Sep 13 14:15:29.381138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:29 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:29.421530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:29.423275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:29.429487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.430403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.431045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.433462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.434164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.434836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.500648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:29.512490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d401d350-4502-442c-a177-ecf1569f07ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1640 microversion: 2.1 time: 0.411114 Sep 13 14:15:29.514860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 266/523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1640 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:29.625679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:29.634131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-91b7086d-1dd8-4b39-8cec-add6431d2c73 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1515 microversion: 2.1 time: 0.217446 Sep 13 14:15:29.637774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 258/524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:29 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:29.655238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:29.656050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:29.663442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.663931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.664487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:29.665363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:29.666284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:29.666794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:30.401930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:30.402638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 0f2fd805-47b4-4a80-b6b9-59570b95d010] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:30.409864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:30.410432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:30.410931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:30.411687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:30.412220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:30.412824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:30.425804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:30.426655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] HTTP exception thrown: Instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 could not be found. Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Request method failure captured: Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 HTTP/1.1 Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjIJBb6C-dTUGISUH1DZW6q_c3NGy_g9dyME7MibojRaWr4ZkpAhPouGdxd87_PpYh8RnPCILJfKcRTNJwWDdIlitvgLDK9p7xC8NQqO76VlL3bmzYJe6lRWxVodPKgU6TlIU4b9LySr_obLmcU2dAnQfAYvtb69C9_QFlBZxlqSoBnag Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: f090725d08904bb3ae6a10598777eaa5 Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesActionsTest-976238350 Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:15:30.428946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f090725d08904bb3ae6a10598777eaa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f090725d08904bb3ae6a10598777eaa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f090725d08904bb3ae6a10598777eaa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f090725d08904bb3ae6a10598777eaa5"}]}] Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesActionsTest-976238350 Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: f090725d08904bb3ae6a10598777eaa5 Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesActionsTest-976238350 Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesActionsTest-976238350-project Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 7479d03b6f9948e3b8a93337c19af60a Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesActionsTest-976238350-project Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 could not be found. Sep 13 14:15:30.430307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '0f2fd805-47b4-4a80-b6b9-59570b95d010'} Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 could not be found. Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:15:30.431029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 could not be found. Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 could not be found. Sep 13 14:15:30.432318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:15:30.433406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Returning 404 to user: Instance 0f2fd805-47b4-4a80-b6b9-59570b95d010 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:15:30.433406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22fe18ee-ddda-4782-a04d-484648ed1660 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010" status: 404 len: 111 microversion: 2.1 time: 0.033488 Sep 13 14:15:30.444069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 259/525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:30 2022] GET /compute/v2.1/servers/0f2fd805-47b4-4a80-b6b9-59570b95d010 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 14:15:30.444808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:30.446597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:30.447725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c88a942-44eb-4bdd-a4ed-143f7acae2f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1752 microversion: 2.20 time: 0.799729 Sep 13 14:15:30.448446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 267/526] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1752 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:30.486635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1760445105", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "networks": [{"uuid": "f68ede55-d296-4e49-9b4a-b80ae9280285"}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:30.545909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] validate_networks() for [('f68ede55-d296-4e49-9b4a-b80ae9280285', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:15:30.659985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:30.661068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:30.668371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:30.669279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:30.669956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:30.670892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:30.672261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:30.672980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:31.108752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:31.121071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2b051f1-f36e-4287-84f2-8e6cf975c114 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1515 microversion: 2.1 time: 0.465686 Sep 13 14:15:31.122270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 268/527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:30 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1515 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:31.181328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:15:31.181889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:15:31.182394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:15:31.182800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:15:31.183209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:15:31.204569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:31.205263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:31.205601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:31.206375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:31.206828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:31.207544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:31.225643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Getting quotas for project f090725d08904bb3ae6a10598777eaa5. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:15:31.229688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Getting quotas for user 7479d03b6f9948e3b8a93337c19af60a and project f090725d08904bb3ae6a10598777eaa5. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:15:31.242087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:15:31.244385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:15:31.290343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f93ce698-59f5-46b7-8e44-3d1194cb8679 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807864 Sep 13 14:15:31.291236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 260/528] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:15:31.311534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98544948-4dc3-4714-a953-797b4340d8cd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:31.313133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98544948-4dc3-4714-a953-797b4340d8cd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:31.417762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98544948-4dc3-4714-a953-797b4340d8cd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:31.426447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98544948-4dc3-4714-a953-797b4340d8cd tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1214 microversion: 2.1 time: 0.126904 Sep 13 14:15:31.428440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 269/529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:31 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:31.452234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-833b1121-83e5-4df3-b408-f852e1db4d61 req-7cae7d57-89f6-4f85-a01f-6af92e15ab62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb9652a-f075-48fa-8725-baf081ae174b", "name": "network-vif-deleted", "tag": "3414c75f-6a03-49f6-bdd4-07d2ef7d2177"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:31.487999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:31.490687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:31.499319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-833b1121-83e5-4df3-b408-f852e1db4d61 req-7cae7d57-89f6-4f85-a01f-6af92e15ab62 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:31.502214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-833b1121-83e5-4df3-b408-f852e1db4d61 req-7cae7d57-89f6-4f85-a01f-6af92e15ab62 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:31.504794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-833b1121-83e5-4df3-b408-f852e1db4d61 req-7cae7d57-89f6-4f85-a01f-6af92e15ab62 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:31.509872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:31.511555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:31.514657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:31.516160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:31.517853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:31.519636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:31.559935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-833b1121-83e5-4df3-b408-f852e1db4d61 req-7cae7d57-89f6-4f85-a01f-6af92e15ab62 service nova] Creating event network-vif-deleted:3414c75f-6a03-49f6-bdd4-07d2ef7d2177 for instance 6cb9652a-f075-48fa-8725-baf081ae174b on hv-cinder-85743 Sep 13 14:15:31.567334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-833b1121-83e5-4df3-b408-f852e1db4d61 req-7cae7d57-89f6-4f85-a01f-6af92e15ab62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136414 Sep 13 14:15:31.567939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 261/530] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:31.797259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:31.816565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:31.823439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:31.826807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a20f88fa-3422-4e18-ac29-5b2dcbb57d2a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.355315 Sep 13 14:15:31.827651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 270/531] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:32.146626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:32.147325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:32.153620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.154236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.154743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.155526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.156239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.156783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.187771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.188148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.188576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.189038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lazy-loading 'fault' on Instance uuid 6cb9652a-f075-48fa-8725-baf081ae174b {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:15:32.231156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:32.239065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-923c1d07-c7d1-4483-aa7f-86b1029d3e79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 200 len: 1309 microversion: 2.1 time: 0.096949 Sep 13 14:15:32.246126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 262/532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:32 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:32.452550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:32.453742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:32.461251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.462298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.462992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.464505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.465588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.466183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.559766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:32.570874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b61604b0-34a6-43d8-9207-1170ff2e1578 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.122544 Sep 13 14:15:32.571616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 271/533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:32 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:32.855793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:32.856432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:32.864390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.865160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.865869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.866799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:32.867469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:32.868046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:32.910244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:33.056987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:33.069143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:33.071181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:33.073132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-35c7c346-c81a-4e58-87e9-c921e30fef55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.222051 Sep 13 14:15:33.074548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 263/534] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:33.264584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:33.267997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 6cb9652a-f075-48fa-8725-baf081ae174b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:33.274618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:33.275134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:33.275573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:33.276282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:33.276742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:33.277166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:33.292391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] HTTP exception thrown: Instance 6cb9652a-f075-48fa-8725-baf081ae174b could not be found. Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Request method failure captured: Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b HTTP/1.1 Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjIJASo_wOAkpWOBaM1Qzhpoc6zKyH82EcqJCfb4N7LCZWyWLFKHDe3QcIJQ1ezvqOkoV4y6OR961rJSq_EVAWHkfKHN59bhAE0-0qGotksqxC2phtAt5YxA5YKFi_5w_pccCxfC18_OHA8m7I6JGSogBTmsND4C3cXCcqr0xt7wPp1jc Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 07cb899fe6934c27820d1329375e044d Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotTestJSON-752431783 Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:15:33.294353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07cb899fe6934c27820d1329375e044d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_07cb899fe6934c27820d1329375e044d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/07cb899fe6934c27820d1329375e044d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/07cb899fe6934c27820d1329375e044d"}]}] Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotTestJSON-752431783 Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 07cb899fe6934c27820d1329375e044d Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-752431783 Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotTestJSON-752431783-project Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 3e4eccc7ece24cf4bcfee361d3342a4f Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotTestJSON-752431783-project Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 6cb9652a-f075-48fa-8725-baf081ae174b could not be found. Sep 13 14:15:33.295836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '6cb9652a-f075-48fa-8725-baf081ae174b'} Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb9652a-f075-48fa-8725-baf081ae174b could not be found. Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:15:33.296643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb9652a-f075-48fa-8725-baf081ae174b could not be found. Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb9652a-f075-48fa-8725-baf081ae174b could not be found. Sep 13 14:15:33.297886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:15:33.299064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Returning 404 to user: Instance 6cb9652a-f075-48fa-8725-baf081ae174b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:15:33.299064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29306d94-03a2-4739-930b-ffd9ed35e617 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b" status: 404 len: 111 microversion: 2.1 time: 0.036319 Sep 13 14:15:33.299064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 272/535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:33 2022] GET /compute/v2.1/servers/6cb9652a-f075-48fa-8725-baf081ae174b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:15:33.585647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-90083c2e-c9ee-4f6a-8202-3098fe5f930a req-130d9c6f-33b1-4753-acd4-74220c1928aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f1a1a8-03b2-4087-a62a-885a432f4852", "tag": "5b53af25-2b95-41ce-9f86-e80d09df687e"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:33.594914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:33.596039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:33.604301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-90083c2e-c9ee-4f6a-8202-3098fe5f930a req-130d9c6f-33b1-4753-acd4-74220c1928aa service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:33.604898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-90083c2e-c9ee-4f6a-8202-3098fe5f930a req-130d9c6f-33b1-4753-acd4-74220c1928aa service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:33.606036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-90083c2e-c9ee-4f6a-8202-3098fe5f930a req-130d9c6f-33b1-4753-acd4-74220c1928aa service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:33.609219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:33.610533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:33.611376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:33.613652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:33.614218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:33.615137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:33.626598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-90083c2e-c9ee-4f6a-8202-3098fe5f930a req-130d9c6f-33b1-4753-acd4-74220c1928aa service nova] Creating event network-changed:5b53af25-2b95-41ce-9f86-e80d09df687e for instance 75f1a1a8-03b2-4087-a62a-885a432f4852 on hv-cinder-85743 Sep 13 14:15:33.632392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-90083c2e-c9ee-4f6a-8202-3098fe5f930a req-130d9c6f-33b1-4753-acd4-74220c1928aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050553 Sep 13 14:15:33.633047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 264/536] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:33.698330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:33.707793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d610512-dd9d-41c4-9621-121f08246710 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.117907 Sep 13 14:15:33.708365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 273/537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:33 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:34.101526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:34.102836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:34.110386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:34.111105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:34.111612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:34.112457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:34.113128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:34.113621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:34.268214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:34.277426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:34.279068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:34.280352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3b875d4b-8d1b-4ee5-b3be-c85c9cbc6d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.183483 Sep 13 14:15:34.280978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 265/538] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:34.733646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:34.734500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:34.740823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:34.741300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:34.741749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:34.742428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:34.742877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:34.743295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:34.806814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:34.815848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17d95f55-4204-4ea8-9ddd-f02f8e2a46b8 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.085384 Sep 13 14:15:34.816204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 274/539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:34 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:35.306418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:35.307084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:35.314116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:35.314589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:35.315015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:35.315690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:35.316137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:35.316552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:35.457346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:35.465853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:35.467294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:35.468444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76ca7f11-c25b-4f92-a00c-416622057def tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.165962 Sep 13 14:15:35.468992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 266/540] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:35.841239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:35.842664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:35.850051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:35.850550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:35.850988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:35.851701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:35.852164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:35.852595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:35.917071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:35.926190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b2992e0-c045-4370-b49e-97fa79ae6c84 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.091060 Sep 13 14:15:35.926937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 275/541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:35 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:36.494214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:36.495058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:36.502733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:36.503253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:36.503862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:36.504604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:36.505052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:36.505470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:36.652005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:36.661358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:36.663055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:36.664271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-187760be-febe-495e-aff0-fe2ba96f0230 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.174237 Sep 13 14:15:36.674626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 267/542] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:36.948758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:36.949372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:36.956718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:36.957196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:36.957630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:36.958344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:36.958801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:36.959225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:37.023856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:37.031525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3cac565-1e4d-43c6-a5b4-3e45a2a04db4 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.086522 Sep 13 14:15:37.032086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 276/543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:36 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:37.693913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:37.694582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:37.701681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:37.702200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:37.703279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:37.704075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:37.704525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:37.704948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:37.863922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:37.873101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:37.875537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:37.876908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d67adc0f-253f-4ec4-9982-1ce81ef7b834 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.187135 Sep 13 14:15:37.877478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 268/544] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:38.053994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:38.054559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:38.061529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:38.062775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:38.063134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:38.063817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:38.064272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:38.064692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:38.151260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:38.161042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a3164c8-fca1-4ef5-b360-d2c9a8d38800 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.110998 Sep 13 14:15:38.161705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 277/545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:38 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:38.902692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:38.903511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:38.906243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:38.911517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:38.912025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:38.912624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:38.913350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:38.913825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:38.914246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:39.065645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:39.074602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:39.076179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:39.077584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-414ae559-45cd-4a2c-bf05-270e62a32fe6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.179203 Sep 13 14:15:39.078309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 269/546] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:39.185047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:39.185668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:39.192447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:39.192825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:39.193256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:39.194122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:39.194579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:39.195008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:39.258802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:39.268176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5aaf6ce2-cf50-44c4-9a91-e3443030a287 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.086888 Sep 13 14:15:39.268943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 278/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:39 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:40.104230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:40.104836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:40.113499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:40.114513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:40.115256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:40.116333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:40.117077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:40.117816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:40.251011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:40.260086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:40.261534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:40.262722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7b630d13-6529-42d8-84b3-8d331c03a0ef tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.162360 Sep 13 14:15:40.263274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 270/548] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:40.292296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:40.292894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:40.300334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:40.301160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:40.301848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:40.302788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:40.303460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:40.304097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:40.368821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:40.378245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a59722ed-575b-4c17-b344-0dd3f37b7845 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.089599 Sep 13 14:15:40.378834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 279/549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:40 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:41.289751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:41.290418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:41.293028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:41.293720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:41.299537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:41.300115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:41.300548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:41.301263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:41.301710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:41.302156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:41.460938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:41.466553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:41.472700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:41.482698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:41.483200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:41.484462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:41.484885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:41.485468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:41.485932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:41.574118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:41.584304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2889f9c-7144-4570-85ca-e5509817ce18 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.127582 Sep 13 14:15:41.585071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 280/550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:41 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:41.717309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:41.736879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:41.738633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:41.739942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8150b9be-8f14-4b44-b2a2-cd3ca1e8840e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.455108 Sep 13 14:15:41.740950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 271/551] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:42.607052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:42.608254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:42.616424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:42.617185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:42.617622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:42.618373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:42.618977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:42.619417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:42.641123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:42.689421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:42.697211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7cf94f10-13e6-420b-8ad2-c5dca5193c5c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.094144 Sep 13 14:15:42.698025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 281/552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:42 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:42.766602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:42.767176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:42.773805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:42.774288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:42.774719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:42.775401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:42.775853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:42.776271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:42.913294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:42.923080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:42.924548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:42.925746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72578503-8cae-4150-8704-e427a3b94df3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.163198 Sep 13 14:15:42.926307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 272/553] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:43.368063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1786358069", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "networks": [{"uuid": "a7cdf52e-f246-4a80-80f0-1dd76fd51c11"}]}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:43.436035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] validate_networks() for [('a7cdf52e-f246-4a80-80f0-1dd76fd51c11', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:15:43.721005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:43.721703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:43.728659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:43.729246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:43.729788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:43.730562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:43.731103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:43.731652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:43.795899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:43.796755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:15:43.797491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:15:43.797596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:15:43.797994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:15:43.798422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:15:43.804734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-43dc648c-72a1-4444-a913-f4f881ae82a9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.088305 Sep 13 14:15:43.805747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 273/554] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:43 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:43.811363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:43.811363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:43.811363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:43.811363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:43.811838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:43.811838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:43.831555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Getting quotas for project 07cb899fe6934c27820d1329375e044d. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:15:43.835593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Getting quotas for user 3e4eccc7ece24cf4bcfee361d3342a4f and project 07cb899fe6934c27820d1329375e044d. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:15:43.847057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:15:43.849358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:15:43.899388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d9101a0d-c44c-435c-b0b2-82bb2fb16d02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535231 Sep 13 14:15:43.900048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 282/555] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:15:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:15:43.912221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b28615d-7f23-4b96-af53-ea13ed553c47 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:43.912941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b28615d-7f23-4b96-af53-ea13ed553c47 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:43.954326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:43.954935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:43.963696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:43.964179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:43.964612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:43.965302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:43.965765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:43.966192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:43.971201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b28615d-7f23-4b96-af53-ea13ed553c47 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:43.978270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b28615d-7f23-4b96-af53-ea13ed553c47 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1219 microversion: 2.1 time: 0.069922 Sep 13 14:15:43.978843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 274/556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:44.111972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:44.121012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:44.122476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:44.123627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80cd9c92-6931-46cb-a30f-f2bcc36fdd95 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.173950 Sep 13 14:15:44.125038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 283/557] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:44.829001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:44.829538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:44.836903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:44.837385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:44.837846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:44.838529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:44.838986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:44.839411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:44.898853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:44.906820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7ce1e1f6-2331-4885-981e-e77b6c71a750 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1266 microversion: 2.1 time: 0.081783 Sep 13 14:15:44.907396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 275/558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:44 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:45.000322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:45.001144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:45.007273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:45.007750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:45.008176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:45.008861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:45.009308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:45.009755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:45.074948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:45.082536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3508daa-56ef-4acf-ac33-d5d8176660a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1215 microversion: 2.1 time: 0.086070 Sep 13 14:15:45.083035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 284/559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:44 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:45.153434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:45.154108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:45.160853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:45.161341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:45.161800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:45.162491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:45.162944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:45.163371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:45.299205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:45.308253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:45.309949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:45.311249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-20580667-4dc9-485c-99fd-531765d768d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.161611 Sep 13 14:15:45.312145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 276/560] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:45.930014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:45.930715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:45.937841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:45.938327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:45.938964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:45.939681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:45.940137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:45.940559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:46.106283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:46.106986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:46.114019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:46.114506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:46.114942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:46.115729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:46.116251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:46.116978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:46.190709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:46.198796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd0c9307-33fe-437d-9786-e55d168bbaa2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1271 microversion: 2.1 time: 0.096918 Sep 13 14:15:46.199377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 277/561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:46 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:46.208117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:46.217466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3d679ae-0ead-4170-9e6d-c01cafe01470 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1272 microversion: 2.1 time: 0.291537 Sep 13 14:15:46.218380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 285/562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:45 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:46.336423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:46.337141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:46.343935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:46.344764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:46.345001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:46.345694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:46.346171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:46.346643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:46.486695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:46.497261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:46.498944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:46.500684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67da0f67-4df4-4abd-a978-bb7fdea4f9ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.168179 Sep 13 14:15:46.501254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 278/563] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:47.221759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:47.222542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:47.225962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:47.230145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:47.230563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:47.231041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:47.231888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:47.232571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:47.233093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:47.245391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:47.246161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:47.253343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:47.253965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:47.254476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:47.255250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:47.255784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:47.256280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:47.334126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:47.342751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7230c3d4-6095-45c2-9cf8-8135b16aa109 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1277 microversion: 2.1 time: 0.124817 Sep 13 14:15:47.361269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 286/564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:47 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:47.395061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:47.402851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-be2f8640-64ae-43cf-96da-c82c2ea75173 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.164310 Sep 13 14:15:47.403416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 279/565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:47 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:47.527294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:47.528353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:47.534966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:47.535562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:47.536157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:47.537018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:47.537537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:47.538054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:47.793109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:47.803886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:47.805359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:47.806544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aab2fabe-77a6-4016-9d0d-56d86fb69aba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.283313 Sep 13 14:15:47.807106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 287/566] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:48.321073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-965a9d00-d5b0-441c-ba93-1743120279c6 req-4bb034b4-c449-4417-8160-ab670d874e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25655cc7-5960-4d42-a6ca-f8c9cd94b7b6", "tag": "9eaafc67-a765-4dcb-b51f-709a0a0c674f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:48.333095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-965a9d00-d5b0-441c-ba93-1743120279c6 req-4bb034b4-c449-4417-8160-ab670d874e2c service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.333491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-965a9d00-d5b0-441c-ba93-1743120279c6 req-4bb034b4-c449-4417-8160-ab670d874e2c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.333956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-965a9d00-d5b0-441c-ba93-1743120279c6 req-4bb034b4-c449-4417-8160-ab670d874e2c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.345853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-965a9d00-d5b0-441c-ba93-1743120279c6 req-4bb034b4-c449-4417-8160-ab670d874e2c service nova] Creating event network-changed:9eaafc67-a765-4dcb-b51f-709a0a0c674f for instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 on hv-cinder-85743 Sep 13 14:15:48.350726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-965a9d00-d5b0-441c-ba93-1743120279c6 req-4bb034b4-c449-4417-8160-ab670d874e2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033448 Sep 13 14:15:48.351385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 280/567] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:15:48.368685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:48.370039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:48.377288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.378011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.378452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.379166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.379621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.380043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.427225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:48.427937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:48.434072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.434559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.434997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.435694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.436186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.436720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.574940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:48.583176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32d6cfa4-4261-4592-a3d6-9fa7e04625b9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.160270 Sep 13 14:15:48.583678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 281/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:48 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:48.700698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:48.708918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6343fd68-d51f-48b4-91a5-bc652e48c7c5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.344373 Sep 13 14:15:48.709493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 288/569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:48.832928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:48.833596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:48.839465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.839942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.840369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.841052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:48.841499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:48.841951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:48.861969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:48.977045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:48.986686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:48.988383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:48.989602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7cda2e11-0a66-4aa5-96e5-fced7bc15c89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.161002 Sep 13 14:15:48.990192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 282/570] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:15:49.606598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:49.607201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:49.614939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:49.615419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:49.615887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:49.616571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:49.617022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:49.617443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:49.731737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:49.732503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:49.739249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:49.739761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:49.740194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:49.740883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:49.741337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:49.741781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:49.750105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:49.763151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19b0fa1a-f3bd-4a58-83d9-47398cd55f60 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.160372 Sep 13 14:15:49.763908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 289/571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:49 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:49.874422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:49.882420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-39e732cd-a388-41dc-8844-f469f20410ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.154568 Sep 13 14:15:49.882988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 283/572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:49 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:50.015478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:50.016079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:50.022247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.022731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.023167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.023852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.024306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.024729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.160368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:50.171957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:50.173510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:50.174715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d636ba46-5772-47ab-9159-42b19c67e11e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.163688 Sep 13 14:15:50.185787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 290/573] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:50.624514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-c3f60da4-9a91-4bf0-a916-e37e7f6c0e4e req-0e74c18d-f554-4b11-97e3-b356ec3b0b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4a1cd1-4081-43bb-ab56-1944c8161e09", "tag": "57509781-5f22-4a8d-8be3-7346ce200acf"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:50.635533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c3f60da4-9a91-4bf0-a916-e37e7f6c0e4e req-0e74c18d-f554-4b11-97e3-b356ec3b0b00 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.636012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c3f60da4-9a91-4bf0-a916-e37e7f6c0e4e req-0e74c18d-f554-4b11-97e3-b356ec3b0b00 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.636436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-c3f60da4-9a91-4bf0-a916-e37e7f6c0e4e req-0e74c18d-f554-4b11-97e3-b356ec3b0b00 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.650263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-c3f60da4-9a91-4bf0-a916-e37e7f6c0e4e req-0e74c18d-f554-4b11-97e3-b356ec3b0b00 service nova] Creating event network-changed:57509781-5f22-4a8d-8be3-7346ce200acf for instance 1a4a1cd1-4081-43bb-ab56-1944c8161e09 on hv-cinder-85743 Sep 13 14:15:50.655016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-c3f60da4-9a91-4bf0-a916-e37e7f6c0e4e req-0e74c18d-f554-4b11-97e3-b356ec3b0b00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034913 Sep 13 14:15:50.656233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 284/574] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:50.787299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:50.787933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:50.794407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.794887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.795325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.796046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.796504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.796930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.906909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:50.907601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:50.913781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.914268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.914695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.915385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:50.915853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:50.916261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:50.927851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:50.935580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa29a7be-77bd-478d-bb77-bfbcc0dd8dd6 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.152167 Sep 13 14:15:50.936175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 291/575] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:50 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:51.044472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:51.052620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42a68bce-363a-4a22-abed-d472ebeab9a7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.150995 Sep 13 14:15:51.053180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 285/576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:51.199905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:51.200508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:51.207482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:51.207967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:51.208406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:51.209122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:51.209579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:51.210049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:51.516157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:51.531055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:51.532628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:51.533817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb69e66e-362b-4273-8cce-60a509c8c5d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.337727 Sep 13 14:15:51.534370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 292/577] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:51.958177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:51.958774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:51.965308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:51.965823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:51.966257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:51.966944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:51.967397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:51.968476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:52.075320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:52.076120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:52.086332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:52.087094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:52.087918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:52.089169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:52.090033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:52.090798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:52.099899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:52.107835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2e2ed30f-e405-4236-8989-29047110ee9b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.153513 Sep 13 14:15:52.108834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 286/578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:51 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:52.226028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:52.234262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb21bf48-fecb-411c-b346-fded3d3a336c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.162214 Sep 13 14:15:52.234854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 293/579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:52.559191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:52.559790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:52.566326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:52.566831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:52.567253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:52.567966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:52.568412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:52.568826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:52.698423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:52.707664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:52.709096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:52.710283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d1cb05c-dc5c-47f9-a3af-acfbb9aa104d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.154986 Sep 13 14:15:52.710831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 287/580] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:53.131406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:53.132025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:53.138161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:53.138650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:53.139087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:53.139782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:53.140243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:53.140681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:53.257344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:53.258240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:53.265759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:53.266472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:53.267158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:53.268080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:53.268730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:53.269356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:53.383517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:53.394438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b044912e-2b58-4d85-a293-d7e8a596fac9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.266649 Sep 13 14:15:53.395670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 294/581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:53 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:53.418797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:53.429248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47910110-1912-4c91-8ad5-9b453939e56f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.175961 Sep 13 14:15:53.430188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 288/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:53 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:53.734754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:53.735421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:53.742923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:53.743446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:53.744042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:53.744749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:53.745201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:53.745623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:53.818728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:53.841842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:53.877303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:53.886202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:53.887712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:53.888884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8742deb0-7591-4dd3-9911-cf05c9eeb0f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.158384 Sep 13 14:15:53.890093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 295/583] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:54.418110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:54.418721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:54.421273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:54.427325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:54.427803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:54.428230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:54.428911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:54.429361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:54.429804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:54.452731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:54.453344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:54.459814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:54.460302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:54.460743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:54.461444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:54.463006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:54.463451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:54.566190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:54.573943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7358a6b-70c5-41ed-b1b6-e78e6e16f771 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.159735 Sep 13 14:15:54.574843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 289/584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:54 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:54.600662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:54.609044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11d53247-9770-4e2d-b0aa-f37b31e5ec6e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.159686 Sep 13 14:15:54.609876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 296/585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:54.914333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:54.914930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:54.921546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:54.922147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:54.922741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:54.924353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:54.924883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:54.925459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:55.055766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:55.064450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:55.065928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:55.067065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-164f5941-c941-42c4-8682-a3f0174ed335 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.156655 Sep 13 14:15:55.067618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 290/586] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:55.596517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:55.597129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:55.603664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:55.604152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:55.604595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:55.605298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:55.605785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:55.606222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:55.632031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:55.632747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:55.640045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:55.640515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:55.640940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:55.641623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:55.642108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:55.642521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:55.740516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:55.748384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7541042-3c30-4ea0-be34-1ddc3fb5c22a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.155810 Sep 13 14:15:55.750257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 297/587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:55 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:55.782735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:55.791158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83d72ad6-6ce7-4f4f-8486-01a2c7e6cb77 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.162860 Sep 13 14:15:55.791725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 291/588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:55 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:56.034802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-c78b76c6-9045-41b1-af53-aad7d45c8c13 req-742da398-3f26-4212-baa8-8196f0932900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "name": "network-vif-plugged", "status": "completed", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:56.044175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c78b76c6-9045-41b1-af53-aad7d45c8c13 req-742da398-3f26-4212-baa8-8196f0932900 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.044649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c78b76c6-9045-41b1-af53-aad7d45c8c13 req-742da398-3f26-4212-baa8-8196f0932900 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.045075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-c78b76c6-9045-41b1-af53-aad7d45c8c13 req-742da398-3f26-4212-baa8-8196f0932900 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.057359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-c78b76c6-9045-41b1-af53-aad7d45c8c13 req-742da398-3f26-4212-baa8-8196f0932900 service nova] Creating event network-vif-plugged:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:15:56.064319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-c78b76c6-9045-41b1-af53-aad7d45c8c13 req-742da398-3f26-4212-baa8-8196f0932900 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033751 Sep 13 14:15:56.064913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 298/589] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:56.095251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:56.096006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:56.102853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.103051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.103485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.104310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.104762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.105747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.244322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:56.253919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:56.255322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:56.256483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8769f82d-1231-4745-a179-ea58a1b37cec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.166074 Sep 13 14:15:56.257082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 292/590] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:56.772511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:56.773240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:56.780405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.780825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.781265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.781982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.782467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.782868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.801119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:15:56.814463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:56.815163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:56.821613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.822137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.822565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.823252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:56.823700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:56.824116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:56.919450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:56.927825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94e59d99-76c6-489d-8be0-7125b95cfae9 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.160235 Sep 13 14:15:56.928395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 299/591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:56 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:56.953900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:56.961338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54f7d7bf-eb36-4988-99dc-53722531b289 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.151388 Sep 13 14:15:56.962107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 293/592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:57.283126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:57.283735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:57.289652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:57.290168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:57.290598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:57.291280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:57.291729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:57.292149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:57.422234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:57.431357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:57.432793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:57.433977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-638862f0-dde7-41ac-af54-4970ebb70f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.155241 Sep 13 14:15:57.434534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 300/593] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:57.950929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:57.951552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:57.959978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:57.960470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:57.960904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:57.961609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:57.962088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:57.962511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:57.985809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:57.986775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:57.993856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:57.994359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:57.994863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:57.995637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:57.996449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:57.997090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:58.110823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:58.118407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-889766a3-03a9-4338-9a6e-e205b78e2726 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.171348 Sep 13 14:15:58.118971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 294/594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:57 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:58.123352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25655cc7-5960-4d42-a6ca-f8c9cd94b7b6", "name": "network-vif-plugged", "status": "completed", "tag": "9eaafc67-a765-4dcb-b51f-709a0a0c674f"}, {"server_uuid": "1a4a1cd1-4081-43bb-ab56-1944c8161e09", "name": "network-vif-plugged", "status": "completed", "tag": "57509781-5f22-4a8d-8be3-7346ce200acf"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:15:58.133517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:58.134012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:58.134439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:58.147582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] Creating event network-vif-plugged:9eaafc67-a765-4dcb-b51f-709a0a0c674f for instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 on hv-cinder-85743 Sep 13 14:15:58.148077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] Creating event network-vif-plugged:57509781-5f22-4a8d-8be3-7346ce200acf for instance 1a4a1cd1-4081-43bb-ab56-1944c8161e09 on hv-cinder-85743 Sep 13 14:15:58.154684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-b575f411-7b96-479e-bed7-c8ab0fe4e8d3 req-e70c4661-ddb4-4d01-a56f-19baea8d20c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034612 Sep 13 14:15:58.155350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 295/595] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:15:58.155882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:58.163952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-967e1ab9-7128-47f5-91c6-043c467fc77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.183440 Sep 13 14:15:58.164570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 301/596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:57 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:58.460338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:58.461023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:58.467122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:58.467597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:58.468023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:58.468735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:58.469180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:58.469593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:58.602192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:58.610809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:58.612264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:58.613418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6bf3ab6b-5f5f-4972-b07b-5b941dc538a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1808 microversion: 2.20 time: 0.157833 Sep 13 14:15:58.614013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 296/597] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:15:59.142064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:59.142729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:59.149605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:59.150261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:59.150613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:59.151252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:59.151707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:59.152131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:59.187608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:59.188374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:59.195030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:59.195871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:59.196402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:59.197601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:59.198296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:59.198837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:59.287189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:59.295028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91ae151a-ba41-4469-9fb0-1c064561fc76 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.157125 Sep 13 14:15:59.295684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 302/598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:59 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:15:59.340236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:59.348028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2a93f94c-8634-4941-9fe6-9496f133a4b0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.164844 Sep 13 14:15:59.348589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 297/599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:15:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:15:59.643869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:15:59.645039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:15:59.651067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:59.651550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:59.651982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:59.652665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:15:59.653116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:15:59.653538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:15:59.785868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:59.794463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:59.796461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:15:59.797687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-783b9ca2-1dd5-4a5c-9d8e-6c61da7c3569 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1795 microversion: 2.20 time: 0.159221 Sep 13 14:15:59.798429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 303/600] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:15:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:16:00.318033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:00.318639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:00.325069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:00.325547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:00.326012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:00.327266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:00.327764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:00.328183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:00.371630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:00.372436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:00.379039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:00.379518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:00.379947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:00.380791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:00.381368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:00.381504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:00.462608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:00.471105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-14d92cf3-7956-40d4-893c-32e7989ae70a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1314 microversion: 2.1 time: 0.156851 Sep 13 14:16:00.471712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 298/601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:00 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:00.516959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:00.525037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87515bcd-3548-44b6-b15e-79889befe23d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.157175 Sep 13 14:16:00.525614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 304/602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:00 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:01.494228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:01.494942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:01.501801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:01.502279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:01.502706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:01.503382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:01.503833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:01.504246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:01.548416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:01.549021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:01.555417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:01.555892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:01.556322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:01.557012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:01.557466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:01.557912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:01.636146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:01.644092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0a351bbb-0a17-4a00-b560-3f93a2a8318b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1498 microversion: 2.1 time: 0.153610 Sep 13 14:16:01.645578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 299/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:01 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:01.694798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:01.706302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24e29316-0b95-4a68-8528-7aa79d0ca3a2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.161563 Sep 13 14:16:01.707023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 305/604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:02.113886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:16:02.116108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:02.122101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.122572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.122994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.124165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.124732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.125160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.144969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:02.203748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4bb8d8c0-31ea-4a86-a57a-1ad03152279d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action" status: 202 len: 0 microversion: 2.1 time: 0.093764 Sep 13 14:16:02.207235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 300/605] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:16:02 2022] POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:16:02.212756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:02.213559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:02.222074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.222727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.223428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.224193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.224805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.225144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.255053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:02.256274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:02.262884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.263454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.263995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.266015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.266568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.267115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.294439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:16:02.380884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed795b52-f228-4228-af4a-eb1b65f1328c tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 204 len: 0 microversion: 2.1 time: 0.129683 Sep 13 14:16:02.385778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 301/606] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:16:02 2022] DELETE /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:16:02.393517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:02.394257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:02.400953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.401438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.401898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.402711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.403057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.403478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.427161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:02.435383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17115023-c05a-4172-8562-428c4f81409c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1751 microversion: 2.1 time: 0.226577 Sep 13 14:16:02.435979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 306/607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:02.543049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:02.550786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0161c18-6c0c-4d77-b4e1-5a4b262d0420 tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1504 microversion: 2.1 time: 0.161615 Sep 13 14:16:02.551343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 302/608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:02 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:02.731533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:02.732137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:02.738973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.739449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.739878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.740558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:02.741009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:02.741508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:02.870099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:02.878236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5023b76c-cf2a-4b5b-be8b-c07a1de8fd13 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.150601 Sep 13 14:16:02.878797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 307/609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:02 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:03.459952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:03.460644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:03.468749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:03.469225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:03.469654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:03.470367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:03.470853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:03.471331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:03.575189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:03.575893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:03.582382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:03.582864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:03.583295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:03.583982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:03.584431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:03.584849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:03.622522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:03.632684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed01a287-7a8b-4ef7-95bf-95c2985e6616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1751 microversion: 2.1 time: 0.176520 Sep 13 14:16:03.633259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 303/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:03.714240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:03.721818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c1dc710-4f97-4bd1-9453-f524cfc4ab7a tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1504 microversion: 2.1 time: 0.150395 Sep 13 14:16:03.722380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 308/611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:03 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:03.901340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:03.901980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:03.908512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:03.908997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:03.909539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:03.910371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:03.911162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:03.911738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:04.047051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:04.054640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3962d0a7-4859-4039-999f-801833a3c071 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1319 microversion: 2.1 time: 0.157180 Sep 13 14:16:04.055190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 304/612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:03 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:04.657468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:04.658129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:04.664649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:04.665121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:04.665548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:04.666264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:04.666712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:04.667127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:04.744776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:04.745412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:04.753197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:04.753680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:04.754178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:04.754879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:04.755334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:04.755751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:04.807452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:04.816478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d63a41ef-200a-4b8a-ae30-3dbdb4f60d44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1751 microversion: 2.1 time: 0.163153 Sep 13 14:16:04.817063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 309/613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:04.891653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:04.900723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a848123-6e44-4e87-9bd9-e60305fd319f tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1504 microversion: 2.1 time: 0.159860 Sep 13 14:16:04.901300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 305/614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:04 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:05.078456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:05.079089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:05.085064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.086005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.086519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.087511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.088385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.088850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.218153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:05.225833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96ece292-bd84-453b-936c-4c9f74dffcd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1508 microversion: 2.1 time: 0.151677 Sep 13 14:16:05.226406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 310/615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:05.249205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5f02a25-caeb-47c6-9246-859ffb754ea9", "device": "/dev/sdb"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:16:05.251824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:05.257806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.258298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.258738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.259425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.259885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.260309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.673302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4561a8e6-00ae-4afb-a8e5-af6362f4d77c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "POST /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428241 Sep 13 14:16:05.673953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 306/616] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:16:05 2022] POST /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:16:05.840775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:05.841556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:05.848775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.849361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.849931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.850737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.851264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.851805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.924988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:05.925711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:05.931798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.932275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.932710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:05.933395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:05.933868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:05.934314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:06.072880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:06.077359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:06.086952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-062777f6-df67-4eb6-bf1f-a8635b020ffe tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1504 microversion: 2.1 time: 0.166489 Sep 13 14:16:06.088259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 307/617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:05 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:06.099726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77396476-880f-4a36-af18-ee370691f579 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1751 microversion: 2.1 time: 0.252619 Sep 13 14:16:06.099726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 311/618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:06.166986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-994fc52b-e13f-4998-8b7d-be7d1ba7d3b1 req-08a9a57e-84dc-43f5-b79a-9a3216f0426e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25655cc7-5960-4d42-a6ca-f8c9cd94b7b6", "name": "network-vif-deleted", "tag": "9eaafc67-a765-4dcb-b51f-709a0a0c674f"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:16:06.177044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-994fc52b-e13f-4998-8b7d-be7d1ba7d3b1 req-08a9a57e-84dc-43f5-b79a-9a3216f0426e service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:06.177518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-994fc52b-e13f-4998-8b7d-be7d1ba7d3b1 req-08a9a57e-84dc-43f5-b79a-9a3216f0426e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:06.177974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-994fc52b-e13f-4998-8b7d-be7d1ba7d3b1 req-08a9a57e-84dc-43f5-b79a-9a3216f0426e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:06.190575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-994fc52b-e13f-4998-8b7d-be7d1ba7d3b1 req-08a9a57e-84dc-43f5-b79a-9a3216f0426e service nova] Creating event network-vif-deleted:9eaafc67-a765-4dcb-b51f-709a0a0c674f for instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 on hv-cinder-85743 Sep 13 14:16:06.195475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-994fc52b-e13f-4998-8b7d-be7d1ba7d3b1 req-08a9a57e-84dc-43f5-b79a-9a3216f0426e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Sep 13 14:16:06.196084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 312/619] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:16:07.111942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:07.112709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:07.114726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:07.115538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:07.119441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:07.119930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:07.120384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:07.121066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:07.121526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:07.121983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:07.122339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:07.122891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:07.124039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:07.124834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:07.125352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:07.125802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:07.157352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:07.157882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:07.158335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:07.158797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lazy-loading 'fault' on Instance uuid 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:16:07.216259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7479d03b6f9948e3b8a93337c19af60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f090725d08904bb3ae6a10598777eaa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:07.230880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7657e620-3142-483d-ada0-e49a33ff1a4b tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 200 len: 1304 microversion: 2.1 time: 0.120754 Sep 13 14:16:07.231756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 313/620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:07 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:07.301644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:07.309768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9bb08ed-fcfa-4172-a243-49a03d8d0306 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.202349 Sep 13 14:16:07.310326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 308/621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:08.269073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:08.269972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] [instance: 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:08.276370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:08.276849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:08.277288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:08.277999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:08.278459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:08.278881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:08.291860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] HTTP exception thrown: Instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 could not be found. Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Request method failure captured: Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 HTTP/1.1 Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjIJBb6C-dTUGISUH1DZW6q_c3NGy_g9dyME7MibojRaWr4ZkpAhPouGdxd87_PpYh8RnPCILJfKcRTNJwWDdIlitvgLDK9p7xC8NQqO76VlL3bmzYJe6lRWxVodPKgU6TlIU4b9LySr_obLmcU2dAnQfAYvtb69C9_QFlBZxlqSoBnag Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: f090725d08904bb3ae6a10598777eaa5 Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesActionsTest-976238350 Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:16:08.293469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f090725d08904bb3ae6a10598777eaa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f090725d08904bb3ae6a10598777eaa5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f090725d08904bb3ae6a10598777eaa5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f090725d08904bb3ae6a10598777eaa5"}]}] Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesActionsTest-976238350 Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: f090725d08904bb3ae6a10598777eaa5 Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesActionsTest-976238350 Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesActionsTest-976238350-project Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 7479d03b6f9948e3b8a93337c19af60a Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesActionsTest-976238350-project Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 could not be found. Sep 13 14:16:08.295037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '25655cc7-5960-4d42-a6ca-f8c9cd94b7b6'} Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 could not be found. Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:16:08.296037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 could not be found. Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 could not be found. Sep 13 14:16:08.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:16:08.298946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] Returning 404 to user: Instance 25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:16:08.298946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bb5d11b-be6f-4197-b0cf-92a5dd0d366d tempest-VolumesActionsTest-976238350 tempest-VolumesActionsTest-976238350-project] 10.222.0.20 "GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6" status: 404 len: 111 microversion: 2.1 time: 0.029695 Sep 13 14:16:08.298946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 314/622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:08 2022] GET /compute/v2.1/servers/25655cc7-5960-4d42-a6ca-f8c9cd94b7b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:16:08.333548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:08.334174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:08.341175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:08.341768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:08.342646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:08.343435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:08.343902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:08.344330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:08.490346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:08.499438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67b11c39-b63c-4ee8-a8fb-0a13e4c54718 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.169691 Sep 13 14:16:08.500276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 309/623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:09.523698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:09.524291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:09.531090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:09.531621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:09.532058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:09.532756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:09.533208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:09.533675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:09.673808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:09.681909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d60171a-49eb-4420-8ebb-c1eaa8083467 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162485 Sep 13 14:16:09.682469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 315/624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:10.705398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:10.706024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:10.708464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:10.714187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:10.714686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:10.715113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:10.715798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:10.716245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:10.716695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:10.858946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:10.867036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e534d21d-1fd2-4963-9ebe-d6644ca6a02f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.166106 Sep 13 14:16:10.867600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 310/625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:11.891706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:11.892319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:11.899641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:11.900119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:11.900585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:11.901267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:11.901718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:11.902161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:12.041621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:12.050138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bd76069-d683-45fd-9893-26ec9aebfa7d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162961 Sep 13 14:16:12.050711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 316/626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:13.073880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:13.074531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:13.081402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.081928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.082362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.083052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.083508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.083933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.238268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:13.246286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b890f20-465b-4fa1-965f-84e177a04779 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.176409 Sep 13 14:16:13.246843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 311/627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:13.629919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:13.630411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:13.637038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.637519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.637987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.639297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.639765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.640190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.643976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:13.663239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a59032d9-2d44-43c9-96ea-51b257e3479b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/ips" status: 200 len: 150 microversion: 2.1 time: 0.037279 Sep 13 14:16:13.663810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 317/628] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:16:13 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:16:13.675298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a89f271-5896-4a9e-849b-3e72cfcf9c6e"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:16:13.677741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:13.684019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.684497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.684936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.686224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.686682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.687122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.771389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Invalid volume: volume 7a89f271-5896-4a9e-849b-3e72cfcf9c6e is already attached to instances: a135d16e-8e8e-4582-ac03-366876df7369 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: POST /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/os-volume_attachments HTTP/1.1 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 74 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:16:13.773415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {"volumeAttachment": {"volumeId": "7a89f271-5896-4a9e-849b-3e72cfcf9c6e"}} Sep 13 14:16:13.774903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Invalid volume: volume 7a89f271-5896-4a9e-849b-3e72cfcf9c6e is already attached to instances: a135d16e-8e8e-4582-ac03-366876df7369 Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'server_id': 'fef415f6-4a45-42df-8fbf-07aaec2d0cf6', 'body': {'volumeAttachment': {'volumeId': '7a89f271-5896-4a9e-849b-3e72cfcf9c6e'}}} Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a89f271-5896-4a9e-849b-3e72cfcf9c6e is already attached to instances: a135d16e-8e8e-4582-ac03-366876df7369 Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:16:13.775692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a89f271-5896-4a9e-849b-3e72cfcf9c6e is already attached to instances: a135d16e-8e8e-4582-ac03-366876df7369 Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:16:13.776932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a89f271-5896-4a9e-849b-3e72cfcf9c6e is already attached to instances: a135d16e-8e8e-4582-ac03-366876df7369 Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 400 to user: Invalid volume: volume 7a89f271-5896-4a9e-849b-3e72cfcf9c6e is already attached to instances: a135d16e-8e8e-4582-ac03-366876df7369 {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e5659041-31a7-459e-bbeb-7e359aa6aa28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103604 Sep 13 14:16:13.778296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 312/629] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:16:13 2022] POST /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 14:16:13.785311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:13.785881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:13.792565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.793048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.793479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.794260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.794721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.795765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.821518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:16:13.904706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32a87984-ee1f-4bdb-bed0-14d1cdbee25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 204 len: 0 microversion: 2.1 time: 0.123552 Sep 13 14:16:13.905470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 318/630] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:16:13 2022] DELETE /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:16:13.913705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:13.914339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:13.921001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.921595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.922071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.922757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:13.923213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:13.923634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:13.928395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:14.063482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:14.073419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c6fe067-6df6-4028-bb2e-169f1374dbbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1680 microversion: 2.1 time: 0.163418 Sep 13 14:16:14.074473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 313/631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:13 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:14.269838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:14.270852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:14.278112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:14.278789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:14.280063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:14.281127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:14.281785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:14.282370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:14.828636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:14.837784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5062a017-8fc8-4299-820c-d2ab19d01705 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.572904 Sep 13 14:16:14.838347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 319/632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:15.098484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:15.099005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:15.106071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:15.106935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:15.108022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:15.109215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:15.109682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:15.110137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:15.268295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:15.277118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b8ac5bec-cc22-424b-849e-a2102a21e4eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1680 microversion: 2.1 time: 0.183151 Sep 13 14:16:15.278341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 314/633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:15 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:15.863296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:15.864577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:15.871726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:15.872689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:15.873956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:15.874930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:15.875629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:15.876315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:16.054072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:16.065496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e56e505-1483-46ac-92f6-fb98d4041cf8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.206242 Sep 13 14:16:16.066392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 320/634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:16.303130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:16.304359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:16.310624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:16.311811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:16.312610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:16.313482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:16.313966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:16.314548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:16.481545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:16.492584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df9c8109-520c-4dfd-af6b-ff4969a58eda tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1680 microversion: 2.1 time: 0.194047 Sep 13 14:16:16.493383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 315/635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:16 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:17.089793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:17.090556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:17.098355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:17.099073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:17.099667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:17.100541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:17.100998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:17.101417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:17.272856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:17.282411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71a2d80a-fc6d-46b3-8116-600adb7be5cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.196525 Sep 13 14:16:17.298369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 321/636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:17.521155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:17.521877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:17.529080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:17.530305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:17.530913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:17.531782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:17.532392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:17.533107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:17.684848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:17.693981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b03250f-9682-4fb5-b3ee-c7460155f6d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1680 microversion: 2.1 time: 0.176813 Sep 13 14:16:17.695154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 316/637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:17 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:18.306560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:18.307254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:18.311713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:18.316516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:18.317226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:18.317838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:18.318534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:18.319131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:18.319838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:18.336254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:18.338562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:18.353622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:18.355377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:18.355976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:18.357971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:18.358323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:18.358846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:18.476905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lazy-loading 'services' on Instance uuid c77e04fe-3528-40f8-8efb-515a6abe4a83 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:16:18.492103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:18.502429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fabf708-a69b-4171-bab2-aa3bcc217e19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.199606 Sep 13 14:16:18.506109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 322/638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:18.565252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2604dde8-0c30-4eaf-8da0-6ec68aeffc97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments/a1c32e17-7d37-4694-a367-e267db9b75c8" status: 202 len: 0 microversion: 2.1 time: 0.235131 Sep 13 14:16:18.569002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 317/639] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 13 14:16:18 2022] DELETE /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments/a1c32e17-7d37-4694-a367-e267db9b75c8 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 14:16:18.719959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:18.720782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:18.731082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:18.736518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:18.737264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:18.738922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:18.739820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:18.740668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:19.057103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:19.065990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94ec7fac-22a0-4c76-9124-d72491bedceb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1680 microversion: 2.1 time: 0.350903 Sep 13 14:16:19.067326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 323/640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:18 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1680 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:19.527221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:19.528718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:19.536103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:19.536879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:19.537532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:19.538727 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:19.539399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:19.539915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:19.749985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-aa355719-fb95-4f20-951c-0d4062dafb6c req-c1bddfa8-1428-4332-ac9d-7a76354ff7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef415f6-4a45-42df-8fbf-07aaec2d0cf6", "name": "network-vif-deleted", "tag": "08756683-d264-47b7-80d4-fa876fa95cd9"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:16:19.769169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:19.771404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-aa355719-fb95-4f20-951c-0d4062dafb6c req-c1bddfa8-1428-4332-ac9d-7a76354ff7dc service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:19.771980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-aa355719-fb95-4f20-951c-0d4062dafb6c req-c1bddfa8-1428-4332-ac9d-7a76354ff7dc service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:19.772649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-aa355719-fb95-4f20-951c-0d4062dafb6c req-c1bddfa8-1428-4332-ac9d-7a76354ff7dc service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:19.781616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2052f647-fd04-481e-a671-ae67cc6524d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.257587 Sep 13 14:16:19.796081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 318/641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:19.804065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-aa355719-fb95-4f20-951c-0d4062dafb6c req-c1bddfa8-1428-4332-ac9d-7a76354ff7dc service nova] Creating event network-vif-deleted:08756683-d264-47b7-80d4-fa876fa95cd9 for instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 on hv-cinder-85743 Sep 13 14:16:19.809551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-aa355719-fb95-4f20-951c-0d4062dafb6c req-c1bddfa8-1428-4332-ac9d-7a76354ff7dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064595 Sep 13 14:16:19.811569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 324/642] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:16:20.090102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:20.091197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:20.099869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:20.100588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:20.101342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:20.102239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:20.102852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:20.103434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:20.177674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:20.188351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82c62f1a-0c51-4847-82d5-494d1f9c5172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.102412 Sep 13 14:16:20.189517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 319/643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:20 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:20.811864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:20.813285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:20.833534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:20.834449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:20.835050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:20.835955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:20.836573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:20.837174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:21.051207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:21.064552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa36c240-8145-480d-a517-c4b6ea83ad1b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.259881 Sep 13 14:16:21.065698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 325/644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:21.212810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:21.214169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:21.231204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:21.231999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:21.233474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:21.238344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:21.239030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:21.239631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:21.327605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:21.337161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9813f61c-d0aa-4f5f-82d9-ec423a42e0bf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.128539 Sep 13 14:16:21.338416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 320/645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:21 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:22.090516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:22.092059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:22.099436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:22.100536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:22.101180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:22.102249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:22.102896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:22.103506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:22.291179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:22.309853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0336daf-b421-4af8-834b-a3c0d8d9b9b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.224992 Sep 13 14:16:22.312188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 326/646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:22.365097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:22.366795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:22.377505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:22.378513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:22.379896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:22.381433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:22.384675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:22.387214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:22.490168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:22.504367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7b23192-96b5-4954-8ec1-d1e9c8988e7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.146893 Sep 13 14:16:22.505587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 321/647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:22 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:23.334637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:23.335258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:23.342523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:23.343052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:23.343488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:23.344201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:23.344683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:23.345105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:23.506110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:23.516196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b9306f7-0583-46a6-8288-692d83c8f391 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.185314 Sep 13 14:16:23.527712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 327/648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:23.530021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:23.530692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:23.537686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:23.538232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:23.538667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:23.539358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:23.539847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:23.540262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:23.608103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:23.616540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0b886141-557f-4953-a356-95f77b2ac8b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.091601 Sep 13 14:16:23.617197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 322/649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:23 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:24.540548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:24.541789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:24.554246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:24.554984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:24.555456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:24.556079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:24.556520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:24.556936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:24.642755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:24.643379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:24.659299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:24.660043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:24.660479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:24.661354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:24.662019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:24.662443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:24.746075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:24.756256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a7418744-0623-4679-b39a-74a590fe35db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.118203 Sep 13 14:16:24.757334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 323/650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:24 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:24.766764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:24.776704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c98adca-e780-4952-a501-3ad9f8d282a1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.239928 Sep 13 14:16:24.777501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 328/651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:25.785438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:25.786065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:25.793120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:25.793887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:25.794271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:25.795671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:25.796391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:25.797035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:25.809266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:25.810125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:25.824650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:25.827585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:25.829344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:25.830617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:25.831692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:25.832279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:25.869807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:25.878961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0a3fb4ec-2636-40b7-b96f-01a98451339a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.097336 Sep 13 14:16:25.890039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 324/652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:25 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:25.992100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:26.000767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f53734d5-1547-4bb8-94fc-dcd163abac00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.199077 Sep 13 14:16:26.001552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 329/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:26.903167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:26.903733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:26.910432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:26.910914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:26.911343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:26.912041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:26.912491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:26.912912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:26.982299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:26.993336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d052a568-87bb-45c3-ae66-34a8b7f6e5c9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.094111 Sep 13 14:16:26.994461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 325/654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:26 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:27.024949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:27.025705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:27.032394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:27.032890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:27.033308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:27.034041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:27.034710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:27.035136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:27.198719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:27.211882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b7773b7-b224-4ccf-895c-aadf468d8df0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.190970 Sep 13 14:16:27.212587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 330/655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:28.016721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:28.018232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:28.025228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:28.025984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:28.026626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:28.027585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:28.028225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:28.029070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:28.094288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:28.103597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-835908ce-1809-4ead-9f9b-1d9f9216988a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.090700 Sep 13 14:16:28.104257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 326/656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:28 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:28.237174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:28.239407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:28.248918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:28.249605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:28.250365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:28.251233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:28.252189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:28.252762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:28.426336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:28.435946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f8f2790-765d-4c24-915e-7e51b273ca91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.201961 Sep 13 14:16:28.445155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 331/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:29.130601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:29.131226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:29.137937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:29.139722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:29.140160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:29.140877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:29.141334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:29.141776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:29.213612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:29.222078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5fff98bb-3fb1-443e-aec8-6fe9e26634cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.095334 Sep 13 14:16:29.222664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 327/658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:29 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:29.471270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:29.472883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:29.483878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:29.484799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:29.486580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:29.487606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:29.488361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:29.488971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:29.651217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:29.659989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fa8d4bc-9bda-4ca5-94ba-b7073f688ee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.192800 Sep 13 14:16:29.668518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 332/659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:30.244827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:30.245431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:30.251970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:30.252446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:30.252873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:30.253638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:30.254324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:30.254730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:30.315910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:30.323528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0fe10c04-d05e-4c57-8288-611f9a25f713 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.082574 Sep 13 14:16:30.324080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 328/660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:30 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:30.685421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:30.686411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:30.693101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:30.693577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:30.694039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:30.694725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:30.695175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:30.695596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:30.699643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:30.839484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:30.847988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ab4cb6f-fb70-412b-974b-0dc05ef13c03 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.167264 Sep 13 14:16:30.848550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 333/661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:31.347526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:31.348192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:31.354536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:31.355008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:31.355435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:31.356114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:31.356593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:31.357635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:31.361643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:31.418954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:31.427198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-74a2100f-bdb6-48f1-87cd-5b3d0e346bf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.083431 Sep 13 14:16:31.427759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 329/662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:31 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:31.870964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:31.871565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:31.877972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:31.878439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:31.878862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:31.879539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:31.879984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:31.880399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:32.018135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:32.026562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a301c93-8642-4b05-8a49-0d9ad4a7db9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.159448 Sep 13 14:16:32.027128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 334/663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:32.450236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:32.450852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:32.457352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:32.457873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:32.458311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:32.459000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:32.459460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:32.459915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:32.520778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:32.528483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9d17caa5-be19-46ed-a307-08b92e7e786b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.082012 Sep 13 14:16:32.529059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 330/664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:32 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:33.050706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:33.051368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:33.057895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:33.058373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:33.058805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:33.059485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:33.059942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:33.060362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:33.201550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:33.210155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24422efc-a696-4f51-9a29-d5aef4f94888 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.163241 Sep 13 14:16:33.210733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 335/665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:33.551644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:33.552274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:33.558653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:33.559127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:33.559553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:33.560234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:33.560684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:33.561622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:33.626994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:33.634548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db31b1e7-986b-404f-8feb-a040c21667c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.086726 Sep 13 14:16:33.635122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 331/666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:33 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:34.235900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:34.236549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:34.244517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:34.244991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:34.245414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:34.246294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:34.246754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:34.247173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:34.405585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:34.414134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97331a79-20b1-4b05-b0bc-7b64d2f549b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.183421 Sep 13 14:16:34.414714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 336/667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:34.660233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:34.660863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:34.669838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:34.671203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:34.672016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:34.673302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:34.674187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:34.674626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:34.738709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:34.747167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97feca0f-2248-4e4d-89b8-532ef5b05528 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.090739 Sep 13 14:16:34.748070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 332/668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:34 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:35.438757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:35.439367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:35.445977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:35.446459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:35.446892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:35.447587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:35.448115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:35.448611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:35.594908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:35.603044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03726cbc-8625-4d76-947c-5ff348fb7900 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.168397 Sep 13 14:16:35.603633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 337/669] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:35.771950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:35.772552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:35.778924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:35.779404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:35.780514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:35.781193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:35.781642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:35.782087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:35.844954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:35.852612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad3e2c53-ca35-4e03-a0ed-49f9e37433bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.084782 Sep 13 14:16:35.853177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 333/670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:35 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:36.626210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:36.626814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:36.633938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:36.634413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:36.634844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:36.635521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:36.636067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:36.636692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:36.781858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:36.790095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e650b5f-7e9c-48ba-ae07-79ef1cce470d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.167737 Sep 13 14:16:36.790666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 338/671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:36.874619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:36.875383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:36.881805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:36.882288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:36.882719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:36.883400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:36.883851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:36.884268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:36.909877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2220799-b755-47a6-9d6a-055057b0dbca"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:16:36.912418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:36.918597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:36.924825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:36.925429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:36.926086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:36.926552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:36.927111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:36.947985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:36.956550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-41a1105c-a5f4-423b-b1b2-7832849ddf34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.085732 Sep 13 14:16:36.957290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 334/672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:36 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:37.814928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:37.815455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:37.821498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:37.822156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:37.822588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:37.823303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:37.823752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:37.824199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:37.967484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:37.975830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aa526949-d53a-4333-b087-9b528f1a1f01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.165468 Sep 13 14:16:37.976398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 335/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:37.985646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:37.986415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:37.992403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:37.992887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:37.993325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:37.994225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:37.994562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:37.994993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:38.058125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:38.066151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-36aeba36-e792-4228-937c-08cb26aff5d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.088673 Sep 13 14:16:38.066656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 336/674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:37 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:39.000309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:39.000921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:39.007378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:39.007866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:39.008304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:39.008997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:39.009463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:39.009919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:39.152014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:39.160666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e8dae339-a97b-4203-a055-6730fb600f47 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.164809 Sep 13 14:16:39.161223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 337/675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:39.165811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:39.166404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:39.172342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:39.172809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:39.173230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:39.173958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:39.174403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:39.174818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:39.238417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:39.246109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48dab3dd-fdf7-4762-84ef-67349126c115 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.083484 Sep 13 14:16:39.246669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 338/676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:39 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:40.183498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:40.184107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:40.190698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:40.191178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:40.191608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:40.192296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:40.192750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:40.193174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:40.334240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:40.342724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b5a03552-8f5f-4132-b9d8-45eb5f516d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162792 Sep 13 14:16:40.343293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 339/677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:40.347685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:40.348284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:40.353965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:40.354454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:40.354886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:40.355581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:40.356099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:40.356521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:40.418421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:40.426906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ac062ab9-e35f-47b6-a5a4-1a7c5189bafb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.082321 Sep 13 14:16:40.427736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 340/678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:40 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:41.366335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:41.366961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:41.369233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=62 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:41.374919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:41.375408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:41.375845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:41.376538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:41.376996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:41.377424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:41.522257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:41.531439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c7d97ff3-ee86-4c1c-bf36-c15d0fd1525f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.168993 Sep 13 14:16:41.532092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 341/679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:41.536753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:41.537422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:41.543066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:41.543611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:41.544248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:41.544935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:41.545420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:41.545860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:41.606134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:41.614978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56405e64-e4ed-4f06-8a75-590ff540e22f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081875 Sep 13 14:16:41.615548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 342/680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:41 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:42.553461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:42.554099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:42.561360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:42.561899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:42.562334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:42.563026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:42.563479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:42.563901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:42.713690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:42.722168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-62dd6cb3-6453-4360-9662-b815059e7afd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.172491 Sep 13 14:16:42.722742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 343/681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:42.727030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:42.727619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:42.733025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:42.733499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:42.733964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:42.734644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:42.735090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:42.735508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:42.800811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:42.808467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4e521d0-8d03-4c8d-a8e3-80b35c5dc6ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.084808 Sep 13 14:16:42.809028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 344/682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:42 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:43.744226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:43.744876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:43.751617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:43.752097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:43.752533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:43.753228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:43.753688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:43.754143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:43.892392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:43.896148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:43.901942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e403550a-ad85-4575-82fe-0b64609d1c88 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.161502 Sep 13 14:16:43.902520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 345/683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:43.907460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:43.908069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:43.913788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:43.914277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:43.914714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:43.915405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:43.915861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:43.916288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:43.976678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:43.985130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a6e5cd0e-bc6c-4971-95aa-39359340d4cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081611 Sep 13 14:16:43.985702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 346/684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:43 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:44.925135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:44.925804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:44.932365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:44.932853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:44.933322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:44.934049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:44.934509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:44.934945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:45.076035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:45.084224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0745348b-2a75-4956-847b-ad5e2d83a1bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162909 Sep 13 14:16:45.084795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 347/685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:45.089129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:45.089788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:45.104959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:45.105452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:45.106660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:45.108981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:45.109456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:45.109924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:45.182428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:45.190023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-77198df9-953b-4086-83e4-b431aabebf46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.104278 Sep 13 14:16:45.190574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 348/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:45 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:46.108523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:46.109211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:46.115064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:46.115541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:46.115969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:46.116645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:46.117092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:46.117509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:46.255865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:46.263938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c5f2ac83-7944-4916-9213-c42c2ce83571 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.159999 Sep 13 14:16:46.264436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 349/687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:46.268690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:46.269546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:46.275191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:46.275754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:46.276189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:46.276876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:46.277329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:46.277768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:46.342859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:46.350560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-52f3f050-fe38-47d8-a824-00c93da11d5c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.085212 Sep 13 14:16:46.351124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 350/688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:46 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:46.919114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=35 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:47.004724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=40 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:47.287266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:47.287924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:47.294447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:47.295011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:47.295545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:47.296242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:47.296701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:47.297126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:47.442280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:47.452719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-50f3e81a-9cbe-4fb2-bbb1-3530c6781a50 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.169257 Sep 13 14:16:47.453300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 351/689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:47.457930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:47.458533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:47.464284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:47.464770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:47.465211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:47.465932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:47.466392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:47.466991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:47.548181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:47.555943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d324e506-1b90-412a-9bfd-930f9350dd29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.101691 Sep 13 14:16:47.556495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 352/690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:47 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:48.475359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:48.475960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:48.483108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:48.483593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:48.484051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:48.484769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:48.485224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:48.485652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:48.631586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:48.640243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42a7c264-1384-48e8-88f9-9cb5775aefaf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.168799 Sep 13 14:16:48.640818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 353/691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:48.645479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:48.646089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:48.651492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:48.651965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:48.652389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:48.653064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:48.653510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:48.653949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:48.715131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:48.723417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33a1cfab-2675-4271-9f6c-8965d194c8d6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081675 Sep 13 14:16:48.723976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 354/692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:48 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:49.663888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:49.664479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:49.671480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:49.671953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:49.672380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:49.673060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:49.673508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:49.673959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:49.814234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:49.822341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f1cce8de-ef2b-400d-b492-7467f788bdac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162309 Sep 13 14:16:49.829780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 355/693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:49.829780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:49.829780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:49.834570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:49.835050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:49.835476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:49.836160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:49.836607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:49.837020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:49.900910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:49.909631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2934629d-59fd-469e-88b3-93ab702c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.085805 Sep 13 14:16:49.910229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 356/694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:49 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:50.150542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:50.150957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:50.157153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.157640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.158093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.158778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.159230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.159652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.188434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-98055776-fd86-4289-b00a-9d1f50c1af88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments/ebee67b3-c11d-4ecf-8a7d-0a938eae31c9" status: 200 len: 194 microversion: 2.20 time: 0.041864 Sep 13 14:16:50.188990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 357/695] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Sep 13 14:16:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments/ebee67b3-c11d-4ecf-8a7d-0a938eae31c9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:16:50.257228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:50.257715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:50.264234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.264723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.265155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.265859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.266313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.266734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.347730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lazy-loading 'services' on Instance uuid 7b2c4488-4c00-4d44-ae73-a78e48c07a1b {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:16:50.419622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b5506616-daa1-41f6-9365-f9989f9e4774 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments/ebee67b3-c11d-4ecf-8a7d-0a938eae31c9" status: 202 len: 0 microversion: 2.20 time: 0.166172 Sep 13 14:16:50.420876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 358/696] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Sep 13 14:16:50 2022] DELETE /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments/ebee67b3-c11d-4ecf-8a7d-0a938eae31c9 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:16:50.429408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:50.431794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:50.438108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.438592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.439030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.439715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.440171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.440595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.470408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6dbb78c1-558f-4118-8b5e-aa158865cbc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045062 Sep 13 14:16:50.470952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 359/697] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:16:50.846791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:50.847442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:50.854197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.854671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.855092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.855772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:50.856216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:50.856625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:50.996789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:51.005778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2f3b1d15-de89-4e69-9122-678c732fb2e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162776 Sep 13 14:16:51.006339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 360/698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:51.010650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:51.011256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:51.017607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:51.018133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:51.018568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:51.019517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:51.019978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:51.020405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:51.080945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:51.084449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:51.089577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89571caf-63ce-4e0a-a3e8-d8388241b8f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.082311 Sep 13 14:16:51.090188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 361/699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:51 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:51.483863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:51.486105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:51.492318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:51.492810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:51.493244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:51.493966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:51.494419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:51.494844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:51.530570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-909ece62-078f-4857-a320-8f96a2890bda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051298 Sep 13 14:16:51.531141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 362/700] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:16:52.029984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:52.030577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:52.036797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:52.037272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:52.037696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:52.038401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:52.038849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:52.039265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:52.181927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:52.190892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4984a1b-494a-4135-974d-642869a3750e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.165051 Sep 13 14:16:52.191460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 363/701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:52.195785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:52.196384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:52.202350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:52.202828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:52.203258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:52.203941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:52.204392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:52.204812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:52.265823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:52.273586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06ab698d-2c26-4aac-a26a-79c0d1832455 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081203 Sep 13 14:16:52.274175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 364/702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:52 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:52.543294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:52.545545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:52.551456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:52.551929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:52.552354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:52.553031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:52.553480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:52.553931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:52.583611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9ea1268-57a5-47fe-af7d-21f1ca15de04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044396 Sep 13 14:16:52.584150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 365/703] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:16:53.214464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:53.215114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:53.221631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:53.222150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:53.222587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:53.223281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:53.223739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:53.224161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:53.364375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:53.372484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-839cc0d9-629c-4dd0-a2eb-5b4e2deba86f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.161805 Sep 13 14:16:53.373554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 366/704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:53.378050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:53.378664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:53.384218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:53.384698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:53.385130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:53.385839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:53.386300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:53.386727 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:53.452018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:53.459811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e1ed77e4-f2a0-45a3-b117-edd56d076a35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.085213 Sep 13 14:16:53.460373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 367/705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:53 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:53.595457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:53.597599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:53.603471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:53.603950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:53.604376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:53.605049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:53.605498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:53.605946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:53.635778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc03feb1-d211-4682-bb54-6e79e5b38087 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044472 Sep 13 14:16:53.636314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 368/706] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:16:54.397119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:54.397808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:54.404928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:54.405405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:54.405869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:54.406554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:54.407006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:54.407425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:54.545197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:54.553387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8982b0f8-d890-43cb-852c-951f5abf2e20 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.160389 Sep 13 14:16:54.553988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 369/707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:54.561805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:54.561805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:54.564809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:54.565284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:54.565715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:54.566419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:54.566868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:54.567286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:54.627483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:54.635015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a2d3bf35-c047-4cbd-9a32-17f54bdfad1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.080108 Sep 13 14:16:54.635576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 370/708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:54 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:54.648330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:54.650456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:54.656366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:54.656837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:54.657272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:54.657981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:54.658432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:54.658845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:54.687813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06059d72-adf9-48f3-876f-a063cc2b7fdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043454 Sep 13 14:16:54.688347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 371/709] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:16:55.577144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:55.577825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:55.584166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:55.584647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:55.585081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:55.585784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:55.586242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:55.586666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:55.732832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:55.740946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7ffd365-1c41-406d-8a4b-a73f5c9e63b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.168322 Sep 13 14:16:55.741502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 372/710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:55.745960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:55.746621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:55.752099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:55.752573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:55.753000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:55.753683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:55.754154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:55.754567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:55.815565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:55.823112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-270b4215-f1d4-4acf-967e-509281c7ace7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.080670 Sep 13 14:16:55.823675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 373/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:55 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:55.829478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:55.831622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:55.837385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:55.837894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:55.838324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:55.839008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:55.839454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:55.839868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:55.869042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3e31af0e-73d7-41ef-88ab-df5bb52b5195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044330 Sep 13 14:16:55.869590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 374/712] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:16:56.764254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:56.764910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:56.771484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:56.771957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:56.772381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:56.773057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:56.773510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:56.773954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:56.913083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:56.922035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f2e157a0-0b9c-4db2-8612-fc39bfa634e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.161811 Sep 13 14:16:56.922603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 375/713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:56.927157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:56.927751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:56.933211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:56.933684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:56.934144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:56.934816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:56.935343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:56.935761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:56.998738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:57.006577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b34614e1-569b-46bb-a8f3-1984ddd239b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.082782 Sep 13 14:16:57.007356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 376/714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:56 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:57.019893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:57.021961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:57.028560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:57.029592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:57.030055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:57.030742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:57.031190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:57.031606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:57.064392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-90000d1f-671d-41e4-a5ef-145e695d0d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049839 Sep 13 14:16:57.065109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 377/715] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:16:57.945321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:57.945997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:57.952788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:57.953264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:57.953692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:57.954404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:57.954855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:57.955276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:57.973548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:16:58.096927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:58.105309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e22b386c-1599-4357-967d-66286e24d83a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.163865 Sep 13 14:16:58.117747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 378/716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:58.122061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:58.122891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:58.128810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:58.129299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:58.129860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:58.130582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:58.130903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:58.131326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:58.193789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:58.202722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d5a8a856-a4fa-4357-8e87-eb317776d574 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.095508 Sep 13 14:16:58.203301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 379/717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:58 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:58.209863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:58.210204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:58.215931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:58.217037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:58.217470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:58.218265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:58.218713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:58.219129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:58.248230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b51514db-c232-4fe7-bca4-c61a7e22667c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043911 Sep 13 14:16:58.248785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 380/718] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:16:59.129644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:59.130291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:59.136772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:59.137322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:59.137688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:59.139056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:59.139521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:59.139944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:59.283642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:59.291749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69ec0817-729d-4f20-aab3-9b5b7f64c5b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.165938 Sep 13 14:16:59.292306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 381/719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:16:59.296720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:59.297306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:59.302858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:59.303418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:59.303871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:59.304642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:59.305126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:59.305581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:59.366113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:16:59.376029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bf6f6346-68e1-4988-8bed-0da6a1be6fd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081118 Sep 13 14:16:59.376029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 382/720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:16:59 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:16:59.379928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:16:59.382166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:16:59.387887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:59.388932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:59.389394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:59.390137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:16:59.390586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:16:59.391005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:16:59.420557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2badfe8d-385d-4663-96b1-4e9cf8df5288 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043952 Sep 13 14:16:59.421159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 383/721] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:16:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:00.315436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:00.316063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:00.322429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:00.322904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:00.323336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:00.324019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:00.324473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:00.324896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:00.463184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:00.471991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-55860c7d-12d7-456a-84a7-30c3f6fc42e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.160363 Sep 13 14:17:00.472555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 384/722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:17:00.476884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:00.477477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:00.483289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:00.483767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:00.484201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:00.484886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:00.485336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:00.485775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:00.549861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:00.557720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54e2c7cf-de13-44fa-9f1b-8f924f368c88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.084181 Sep 13 14:17:00.558320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 385/723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:00 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:00.563442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:00.565559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:00.571464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:00.571942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:00.572373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:00.573058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:00.573509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:00.573956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:00.603309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ceb7d96-271f-40bf-970d-835c4bedabb7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043981 Sep 13 14:17:00.603860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 386/724] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:01.495139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:01.495750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:01.502853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:01.503333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:01.503763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:01.504450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:01.504902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:01.505318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:01.649831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:01.658320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5c5c7a6-d61f-46cc-bfdb-caa3ae92ad4e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.167040 Sep 13 14:17:01.658893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 387/725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:17:01.663282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:01.663881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:01.669954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:01.670605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:01.671247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:01.671937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:01.672392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:01.672819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:01.734516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:01.742274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-827fc5fc-ee6f-4744-9ec2-d4402bf4ef9f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.082428 Sep 13 14:17:01.742835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 388/726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:01 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:01.747389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:01.749489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:01.755399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:01.755887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:01.756328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:01.757071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:01.757556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:01.758025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:01.788804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-431d2680-6232-43c9-bdf3-f7ee0bea374c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044994 Sep 13 14:17:01.789358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 389/727] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:02.682534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:02.683145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:02.690332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:02.690835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:02.691276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:02.691963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:02.692421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:02.692847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:02.837372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:02.845636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc98da9b-251e-4918-b42d-e3a28ca2488e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.167016 Sep 13 14:17:02.846222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 390/728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:17:02.850507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:02.851134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:02.852712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:02.857750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:02.858233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:02.858664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:02.859346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:02.859803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:02.860229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:02.920926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:02.928499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8a5ed7ad-45aa-4b8f-9428-7ddcf8fdef33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081358 Sep 13 14:17:02.929059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 391/729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:02 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:02.933755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:02.936643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:02.942124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:02.942599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:02.943030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:02.943713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:02.944164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:02.944586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:02.973810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-481cf510-b976-4254-a460-15ba269f9f78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043761 Sep 13 14:17:02.974359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 392/730] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:03.869228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:03.869961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:03.876688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:03.877170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:03.877592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:03.878302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:03.878749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:03.879164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:04.019378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:04.027590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c502c58-18e1-4ecf-999c-a72c2f258d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.162257 Sep 13 14:17:04.028155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 393/731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:17:04.032712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:04.033315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:04.038985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:04.039575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:04.040014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:04.040708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:04.041181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:04.041583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:04.104775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:04.113023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-670b0ebf-4019-4239-94e9-7f6d784c311a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.083883 Sep 13 14:17:04.113586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 394/732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:04 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:04.118072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:04.120242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:04.126244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:04.126741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:04.127156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:04.127836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:04.128286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:04.128713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:04.132313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:04.157722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8f0ab649-6cf3-4f7e-9ae1-fc134f479a11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043130 Sep 13 14:17:04.158288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 395/733] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:05.050900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:05.051540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:05.057994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:05.058477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:05.058911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:05.059595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:05.060756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:05.061185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:05.200217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:05.208958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-01b151ac-11f8-454a-8afc-8899b634b7a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.161962 Sep 13 14:17:05.209519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 396/734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:17:05.213918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:05.214519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:05.220037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:05.220507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:05.220942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:05.221639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:05.222117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:05.222542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:05.284276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:05.291930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e1bac0a6-369a-426e-9d53-96b53cf4765e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.081465 Sep 13 14:17:05.292488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 397/735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:05 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:05.297281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:05.299445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:05.305126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:05.305536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:05.305997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:05.306676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:05.307122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:05.307537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:05.337131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-768e91d1-e029-49d2-85cb-9838197dbfe1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043656 Sep 13 14:17:05.337674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 398/736] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:06.232900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:06.233541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:06.240458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:06.240986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:06.241497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:06.242253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:06.242718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:06.243145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:06.400974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:06.409108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e6c77607-649f-4897-93c2-e53cbf374cfc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.180559 Sep 13 14:17:06.409676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 399/737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:17:06.414027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:06.414982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:06.421133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:06.421614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:06.422069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:06.422786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:06.423241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:06.423661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:06.486295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:06.493976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-802ee8f3-a4c8-459c-b0c1-45d8672c5ea1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1614 microversion: 2.1 time: 0.083306 Sep 13 14:17:06.494541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 400/738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:06 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:06.499894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:06.502114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:06.508091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:06.508770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:06.509211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:06.509963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:06.510421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:06.510840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:06.553155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dd074ccb-3cb0-45da-8fed-065f8cbe3018 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057614 Sep 13 14:17:06.553710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 401/739] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:07.363403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea592ffa-deae-447b-a73f-f8f6a9b1c68e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "POST /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 30.457304 Sep 13 14:17:07.364455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 339/740] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Sep 13 14:16:36 2022] POST /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852/os-volume_attachments => generated 194 bytes in 30460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:07.432361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:07.432990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:07.440104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.440577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.441004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.441681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.442152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.442566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.521636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:07.522571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:07.533541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.537491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.537600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.538371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.540182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.541974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.583468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.583963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.584416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.584824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lazy-loading 'fault' on Instance uuid fef415f6-4a45-42df-8fbf-07aaec2d0cf6 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:17:07.612016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:07.621713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-20b201b8-3ab7-46d7-9ab8-592b90503480 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1756 microversion: 2.1 time: 0.193155 Sep 13 14:17:07.623340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 402/741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:07.627186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:07.628178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:07.630762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:07.634821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e04be6e-f6a2-44f0-ab05-ef865aa9088d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 200 len: 1331 microversion: 2.1 time: 0.117988 Sep 13 14:17:07.650134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 340/742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:07 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:07.650258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.650258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.650258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.650258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:07.650629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:07.651082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:07.681527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a613fd91-4910-470a-938f-97e04ca9d808 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057237 Sep 13 14:17:07.682113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 403/743] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:08.646992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:08.647632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:08.654607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:08.655074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:08.655500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:08.656188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:08.656634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:08.657053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:08.668370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:08.669170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:08.675758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:08.676234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:08.676668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:08.677374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:08.677854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:08.678466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:08.692716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 HTTP/1.1 Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:17:08.694405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:17:08.696106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': 'fef415f6-4a45-42df-8fbf-07aaec2d0cf6'} Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:17:08.697067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:17:08.699051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:17:08.700175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:17:08.700175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30a7c724-9622-4446-a679-6f8d91d01ece tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 404 len: 111 microversion: 2.1 time: 0.031333 Sep 13 14:17:08.700175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 404/744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:08 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 14:17:08.704614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:08.707050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:08.713030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:08.713517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:08.713983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:08.714689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:08.715143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:08.715569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:08.748785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-15b2a294-bc04-407c-8cc5-4859242cd6d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051476 Sep 13 14:17:08.749342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 405/745] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:08.753929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e2df289-5dc8-4bd2-a6a4-b42fb65aaa58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '.version_select at 0x7fc9cff7e9d0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:08.774191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e2df289-5dc8-4bd2-a6a4-b42fb65aaa58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-246693700" status: 202 len: 0 microversion: 2.1 time: 0.023756 Sep 13 14:17:08.774757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 406/746] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 13 14:17:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-246693700 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:17:08.813024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:17:08.821958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4595c28b-ffbc-4169-80fa-be2b7c833ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1759 microversion: 2.1 time: 0.178914 Sep 13 14:17:08.822536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 341/747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:17:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:17:09.455987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:09.456480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:09.462285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:09.462767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:09.463200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:09.463883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:09.464330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:09.464747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:09.583965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lazy-loading 'services' on Instance uuid a135d16e-8e8e-4582-ac03-366876df7369 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:17:09.653116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e901f562-a911-4721-b92a-d38fec5e9d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments/7a89f271-5896-4a9e-849b-3e72cfcf9c6e" status: 202 len: 0 microversion: 2.1 time: 0.200918 Sep 13 14:17:09.653765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 407/748] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 13 14:17:09 2022] DELETE /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments/7a89f271-5896-4a9e-849b-3e72cfcf9c6e => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:17:09.662212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:09.665057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:09.672186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:09.673025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:09.673650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:09.674545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:09.675155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:09.675577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:09.708307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5f67bd4-2d1b-4e7e-aae0-a30d5602a673 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048814 Sep 13 14:17:09.708307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 342/749] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:09.761545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:09.764796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:09.771330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:09.771804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:09.772231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:09.772913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:09.773360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:09.773796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:09.804198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3e6bcbc1-4ba8-49f2-9d7d-7e62c244c8b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047580 Sep 13 14:17:09.804743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 408/750] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:10.719819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:10.722191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:10.728687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:10.729156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:10.729577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:10.730290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:10.730738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:10.731149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:10.761545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa2f2f34-1404-4523-8b35-0f594b9b5edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Sep 13 14:17:10.762124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 343/751] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:10.816880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:10.819057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:10.826058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:10.826538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:10.826976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:10.827667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:10.828123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:10.828543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:11.014023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c964cc4a-0d91-4b0e-a719-1a06be033457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.200109 Sep 13 14:17:11.014507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 409/752] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:11.774040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:11.776413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:11.783507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:11.783987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:11.784416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:11.785102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:11.785560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:11.786006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:11.817861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bad6b24-f79e-4a62-a4e9-b7ca7f8ae2f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Sep 13 14:17:11.818435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 344/753] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:12.026536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:12.028690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:12.035016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:12.035486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:12.035911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:12.036588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:12.037033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:12.037451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:12.066762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3778c7c1-1c0f-4f8d-85b8-12131dcd62b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044256 Sep 13 14:17:12.067296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 410/754] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:17:12.830695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:12.832887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:12.839269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:12.839745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:12.840179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:12.840899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:12.841351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:12.841791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:12.876248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4b9d3c3-0bff-49b6-83c9-eca36b0546fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049408 Sep 13 14:17:12.876803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 345/755] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:13.079671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:13.081874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:13.088188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:13.088659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:13.089088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:13.089791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:13.090241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:13.090657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:13.119297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b8960cd-7523-497d-b9fa-c7548df5d696 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044125 Sep 13 14:17:13.119825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 411/756] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:13.889438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:13.891613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:13.898353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:13.898838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:13.899275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:13.900004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:13.900460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:13.900881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:13.932188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cdfcf72-05c0-46cd-b493-900d3d3b57b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047616 Sep 13 14:17:13.932750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 346/757] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:14.131743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:14.133917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:14.143248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:14.144493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:14.145110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:14.145838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:14.146293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:14.146713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:14.176046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:14.181301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9ff5868a-8365-4d00-86b5-97ad9ffcbc8e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053520 Sep 13 14:17:14.181879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 412/758] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:14.944594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:14.946699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:14.953695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:14.954202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:14.954628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:14.955319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:14.955764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:14.956175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:14.985658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ba86740d-585d-44cc-95c6-7160fc97b0f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Sep 13 14:17:14.986299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 347/759] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:15.194355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:15.196487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:15.203297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:15.203773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:15.204202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:15.204883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:15.205335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:15.205781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:15.240412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1bf64278-dc0f-48ec-b500-007c53906862 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050521 Sep 13 14:17:15.241018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 413/760] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:15.998140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:16.000530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:16.006918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:16.007391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:16.007818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:16.008538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:16.009138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:16.009558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:16.041770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b7f00c9-39bf-45d2-9af8-a3e0eb61abd0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047522 Sep 13 14:17:16.042570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 348/761] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:16.253117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:16.255248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:16.261298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:16.261809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:16.262241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:16.263413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:16.263918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:16.264356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:16.294379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47dc937d-a402-472a-8849-f57f85844dd1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045042 Sep 13 14:17:16.294820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 414/762] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:17.054102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:17.056259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:17.062836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:17.063315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:17.063754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:17.064450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:17.064901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:17.065319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:17.095180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f649e351-d56e-4c5a-a5cf-e7f802e9fd33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Sep 13 14:17:17.095740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 349/763] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:17.412093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:17.414266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:17.420926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:17.421346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:17.421800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:17.422488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:17.422939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:17.423359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:17.455797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8dbc908-e0f5-45e4-a1ec-f4f96956763c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.153173 Sep 13 14:17:17.456379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 415/764] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:18.107242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:18.109393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:18.115933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:18.116404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:18.116831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:18.117517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:18.117991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:18.118439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:18.149375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9cc592c5-0bd0-4874-82b9-71cf80dff944 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046257 Sep 13 14:17:18.150084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 350/765] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:18.468327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:18.470483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:18.477020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:18.477440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:18.477908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:18.478590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:18.479040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:18.479457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:18.508974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-977e5589-5758-46a2-8758-aefeb45827b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044711 Sep 13 14:17:18.509511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 416/766] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:19.161704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:19.164262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:19.171542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:19.172021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:19.172444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:19.173133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:19.173581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:19.174037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:19.204104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d0b070d-2e37-4172-9fe8-6d4242ce867d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046219 Sep 13 14:17:19.204656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 351/767] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:19.521717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:19.523876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:19.531247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:19.531737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:19.532175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:19.532875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:19.533330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:19.533770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:19.563540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf4a8208-528e-4474-8f08-b3332480c195 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046032 Sep 13 14:17:19.564086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 417/768] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:20.216585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:20.218743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:20.225007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:20.225486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:20.225954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:20.226647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:20.227114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:20.227523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:20.258497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57f2cc04-b7c5-48b6-b6f2-0953aab15d20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Sep 13 14:17:20.259046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 352/769] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:20.576234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:20.578457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:20.584796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:20.585276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:20.585707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:20.586414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:20.586864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:20.587280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:20.616583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-214a1d0e-5326-4c5e-bddb-cf3e8e16ab2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044293 Sep 13 14:17:20.617044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 418/770] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:21.271387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:21.273599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:21.280451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:21.280919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:21.281342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:21.282053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:21.282501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:21.282914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:21.312709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2ec4080-cdba-45ae-b8e2-31cfe9ecfe45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Sep 13 14:17:21.313263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 353/771] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:21.628682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:21.631095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:21.638055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:21.638655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:21.639187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:21.639878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:21.640380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:21.640798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:21.670530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-81b578d1-469d-4e07-95f3-8e9dd7796738 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045778 Sep 13 14:17:21.671097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 419/772] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:22.324657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:22.326836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:22.333369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:22.333879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:22.334305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:22.334991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:22.335437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:22.335852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:22.361933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:22.367135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17765011-bc7e-4619-9d29-f4318a163239 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Sep 13 14:17:22.367687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 354/773] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:22.682959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:22.685093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:22.691451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:22.691931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:22.692364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:22.693049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:22.693504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:22.693960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:22.723350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e4034d52-bf23-4118-8e4f-e7ed5cc248c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044362 Sep 13 14:17:22.723902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 420/774] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:23.380246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:23.382452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:23.390022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:23.390494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:23.390918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:23.391607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:23.392051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:23.392461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:23.422864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-987e93e3-82e0-48a1-9428-ef01b3f748ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Sep 13 14:17:23.423411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 355/775] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:23.736380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:23.738504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:23.744806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:23.745276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:23.745708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:23.746406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:23.747733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:23.748155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:23.776923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-608df74f-e6df-46f4-998c-1e7b12335297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044654 Sep 13 14:17:23.777465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 421/776] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:24.434988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:24.437125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:24.443479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:24.443956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:24.444388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:24.445104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:24.445557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:24.446009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:24.477754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa2c026a-6c5e-4e55-b889-a915edf72b28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Sep 13 14:17:24.478471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 356/777] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:24.789766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:24.791911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:24.798301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:24.798732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:24.799177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:24.799857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:24.800307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:24.800725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:24.830521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0df6323-e1b8-43cb-8683-bf969fb8b6b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Sep 13 14:17:24.830998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 422/778] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:25.490393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:25.492568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:25.499453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:25.499927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:25.500356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:25.501050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:25.501501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:25.501955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:25.533066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-842af0f3-156f-455d-a288-a69ed2d4e4f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046570 Sep 13 14:17:25.533632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 357/779] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:25.844099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:25.846279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:25.852701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:25.853179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:25.853612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:25.854340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:25.854791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:25.855212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:25.883679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76e93d64-9ca7-46a4-bfd7-3508ff50d5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044801 Sep 13 14:17:25.884226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 423/780] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:26.544645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:26.546922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:26.553872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:26.554434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:26.554940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:26.555846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:26.556305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:26.556729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:26.586809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7050d6a-19d1-43e3-8e60-1acf2b80c9c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Sep 13 14:17:26.587375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 358/781] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:26.896839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:26.898964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:26.905509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:26.906011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:26.906442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:26.907114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:26.907558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:26.907970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:26.937099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e0ca0fc3-1a08-4f9b-ac57-578923688bb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044348 Sep 13 14:17:26.937649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 424/782] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:27.599184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:27.601549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:27.608488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:27.608964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:27.609390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:27.610140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:27.610588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:27.611007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:27.640661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bca0cce9-f3de-462f-8244-f9228631b22e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Sep 13 14:17:27.641222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 359/783] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:27.950132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:27.952334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:27.958771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:27.959253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:27.959683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:27.960367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:27.960818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:27.961237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:27.990022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58b611eb-4c87-4ec0-8b76-90c7d3a0e887 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044306 Sep 13 14:17:27.990567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 425/784] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:17:28.653127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:28.655303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:28.661622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:28.662144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:28.662574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:28.663266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:28.663716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:28.664136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:28.695008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-34fa6e4d-b5dc-41be-9f51-a40dea5b0921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045850 Sep 13 14:17:28.695564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 360/785] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:29.003398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:29.005521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:29.011910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:29.012420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:29.012852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:29.013538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:29.014009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:29.014431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:29.044141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1cc79e35-724e-4926-a946-6b13fef76b93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Sep 13 14:17:29.044694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 426/786] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:29.706953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:29.710787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:29.717881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:29.718364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:29.718789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:29.719479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:29.719925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:29.720341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:29.750015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-399857ad-4224-49b5-9e65-2f9b34d1bc3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Sep 13 14:17:29.750573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 361/787] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:30.056466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:30.059791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:30.066068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:30.066543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:30.066973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:30.067654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:30.068102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:30.068518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:30.098153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d9518429-c32e-4bad-a8df-247c413b27d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045494 Sep 13 14:17:30.098719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 427/788] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:17:30.761825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:30.764002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:30.770623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:30.771096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:30.771522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:30.772207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:30.772789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:30.773053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:30.803665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8691a912-18c0-49b5-810e-0baa4cb9a50f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045793 Sep 13 14:17:30.804211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 362/789] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:31.110533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:31.112747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:31.119070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:31.119581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:31.120016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:31.120687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:31.121136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:31.121554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:31.150150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-265e8ba8-6b97-455f-9cf4-fb0bd2c28d4d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043500 Sep 13 14:17:31.150679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 428/790] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:17:31.815622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:31.817847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:31.824982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:31.825464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:31.825946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:31.826638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:31.827087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:31.827504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:31.858032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7186a2c0-e2e1-4367-a5b7-6af14d7d1216 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046216 Sep 13 14:17:31.858591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 363/791] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:32.162701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:32.164831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:32.171660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:32.172142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:32.172588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:32.173287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:32.173760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:32.174190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:32.191329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:32.206103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e1d50ad9-8373-4490-a802-ce6b93670273 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047319 Sep 13 14:17:32.206661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 429/792] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:32.869934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:32.872277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:32.878648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:32.879118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:32.879546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:32.880231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:32.880706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:32.881081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:32.911501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df54f891-bf60-4cec-9d03-4c496d138b02 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Sep 13 14:17:32.912047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 364/793] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:33.219332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:33.221467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:33.223851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:33.229077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:33.229563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:33.230021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:33.230710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:33.231477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:33.231904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:33.262613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4624f2c9-6d7e-4829-a72d-604b10c84498 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047565 Sep 13 14:17:33.263157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 430/794] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:34.029308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:34.031475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:34.037370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:34.037894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:34.038334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:34.039025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:34.039487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:34.039926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:34.070660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48c11ae0-b954-4a34-a55d-a205db9f19bc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150437 Sep 13 14:17:34.071215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 365/795] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:34.275424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:34.278264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:34.285121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:34.285606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:34.286065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:34.286767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:34.287215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:34.287636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:34.317910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eff8ffcb-47bd-47ff-b0f8-f54a5a2bb2d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046404 Sep 13 14:17:34.318475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 431/796] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:35.083402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:35.085528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:35.092026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:35.092505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:35.092938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:35.093627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:35.094107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:35.094531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:35.124831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-739c4ad5-5af6-4589-a6c4-e43ed3cec80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Sep 13 14:17:35.125413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 366/797] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:35.331059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:35.333169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:35.335515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:17:35.335631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:17:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:17:35.342628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:35.343112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:35.343535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:35.344231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:35.344675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:35.345091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:35.375307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c920b621-24ac-4561-8b8a-061a67be0ae1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048169 Sep 13 14:17:35.375860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 432/798] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:36.136371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:36.138544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:36.145064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:36.145543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:36.145994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:36.146668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:36.147112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:36.147528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:36.177480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ac38a5c-1abe-47d3-8bf7-6443674828c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Sep 13 14:17:36.178062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 367/799] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:36.388133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:36.390340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:36.397084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:36.397562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:36.398018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:36.398706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:36.399158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:36.399578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:36.428628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d42ef3fe-19ba-4484-a657-69ccc3e7253f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044941 Sep 13 14:17:36.429445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 433/800] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:37.190545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:37.192928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:37.195421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=59 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:37.201069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:37.201547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:37.202017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:37.202710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:37.203166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:37.203601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:37.235026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a36a1021-6052-41ce-b4c7-19291751a61e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048591 Sep 13 14:17:37.235634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 368/801] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:37.440624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:37.442827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:37.449042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:37.449536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:37.449966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:37.450650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:37.451097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:37.451512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:37.480131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4e3c89d8-8e6c-49e9-9924-b2526d1dea5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043569 Sep 13 14:17:37.481392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 434/802] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:38.248108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:38.250263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:38.256635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:38.257111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:38.257537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:38.258247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:38.258699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:38.259118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:38.288932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f998d496-e780-4852-bb2e-9ff2325ec048 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Sep 13 14:17:38.289487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 369/803] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:38.492439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:38.494600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:38.501797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:38.502277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:38.502708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:38.503400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:38.503850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:38.504267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:38.533867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f7d08ae-9823-40b1-9a90-1b1e377bfb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045226 Sep 13 14:17:38.534426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 435/804] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:39.301272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:39.303461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:39.310088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:39.310567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:39.311001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:39.311689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:39.312142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:39.312561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:39.342823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e8f066b-3c23-4263-ae41-2c1c140d9a4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045507 Sep 13 14:17:39.343387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 370/805] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:39.548612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:39.548612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:39.554726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:39.555318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:39.555748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:39.556429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:39.556877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:39.557293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:39.586618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6320ef79-b841-42d5-b747-2eec41446bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044443 Sep 13 14:17:39.587165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 436/806] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:40.355270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:40.358019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:40.364408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:40.364905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:40.365319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:40.366049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:40.366502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:40.366923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:40.383493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:40.397373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ce2a5cc-82e9-44b8-b6e2-ddf66e91b8b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Sep 13 14:17:40.397959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 371/807] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:40.599366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:40.601752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:40.608873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:40.609350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:40.609800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:40.610483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:40.610929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:40.611344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:40.642119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f45fd64a-ee0d-488a-b972-45ccefd64323 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046889 Sep 13 14:17:40.642680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 437/808] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:17:41.409258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:41.411463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:41.418356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:41.418831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:41.419263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:41.419948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:41.420400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:41.420818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:41.450410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68895c4e-269b-4aae-af6e-e21b36e6f628 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Sep 13 14:17:41.450960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 372/809] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:41.655198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:41.657318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:41.663839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:41.664312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:41.664739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:41.665419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:41.665899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:41.666316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:41.697274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-27a5a5ab-fcb8-4b1c-9b3f-d6904193501b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046328 Sep 13 14:17:41.697843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 438/810] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:42.462688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:42.465432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:42.471848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:42.472323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:42.472750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:42.473436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:42.473923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:42.474345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:42.503134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b98faeeb-c959-45c0-aa02-edf783c03935 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Sep 13 14:17:42.503722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 373/811] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:42.709624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:42.711952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:42.718489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:42.718967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:42.719394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:42.720079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:42.720523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:42.720936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:42.749690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7ffa263f-5dd1-4244-963b-6185cdebba13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043994 Sep 13 14:17:42.750251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 439/812] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:43.515535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:43.517671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:43.524568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:43.525047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:43.525482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:43.526228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:43.526681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:43.527614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:43.557387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2547ab4-e26f-46f9-b802-4e864c90c736 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Sep 13 14:17:43.557976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 374/813] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:43.767127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:43.769491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:43.775965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:43.776454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:43.776890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:43.778179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:43.778635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:43.779053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:43.808038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-95a3b64d-ba61-4d7a-856a-4ed7a8cea017 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044768 Sep 13 14:17:43.808587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 440/814] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:44.570104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:44.572275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:44.578975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:44.579450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:44.579884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:44.580569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:44.581025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:44.581445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:44.610508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-13bea67e-e0a3-48b7-9c4a-64b8fbe0303c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044348 Sep 13 14:17:44.611055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 375/815] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:44.820414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:44.823608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:44.829991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:44.830521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:44.830905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:44.831607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:44.832064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:44.832492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:44.865742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c9b65297-144b-48b1-85f5-21da28b81bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049380 Sep 13 14:17:44.866313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 441/816] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:45.622597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:45.624767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:45.631189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:45.631672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:45.632109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:45.632801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:45.633264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:45.633686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:45.663321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cc040d6-c2fc-449a-9a61-7e7c1927e36c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Sep 13 14:17:45.663867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 376/817] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:45.880111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:45.882844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:45.889402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:45.889914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:45.890378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:45.891065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:45.891513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:45.892009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:45.921324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ddb7f00c-9fec-450b-b400-5b3a9e14fb93 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046304 Sep 13 14:17:45.921898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 442/818] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:46.675867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:46.678059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:46.685066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:46.685490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:46.685957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:46.686646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:46.687097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:46.687517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:46.724730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1881375d-3424-4311-bdc3-4d79d61ca529 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052716 Sep 13 14:17:46.725287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 377/819] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:46.936265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:46.938490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:46.944657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:46.945140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:46.945567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:46.946282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:46.946728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:46.947145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:46.975723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f222e5b1-5f52-4ea7-b0ca-99e12953626b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045981 Sep 13 14:17:46.976264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 443/820] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:17:47.283816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-429714885"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:17:47.284350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:47.290357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:47.290832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:47.291265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:47.291947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:47.292397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:47.292816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:47.478557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.network.security_group_api [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Removing security group 37f15c7f-6e71-4d0e-89f9-da4041c2d7a7 from port 974f489a-92d3-4fbf-bb59-7a9a63bf7378 Sep 13 14:17:47.736795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:47.739132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:47.745139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:47.745622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:47.746341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:47.747788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:47.748431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:47.748861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:47.779920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-690a4829-854c-44f8-b6bf-b9d8fb10b20d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047133 Sep 13 14:17:47.780492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 444/821] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:47.788225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9a2543f-a670-4b3b-a392-2664ccbae040 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action" status: 202 len: 0 microversion: 2.1 time: 0.507948 Sep 13 14:17:47.788896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 378/822] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:17:47 2022] POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 14:17:47.814864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-2cbd6d83-000a-4134-a23f-80eea2efdfa6 req-32961cae-15dc-4fc2-976d-b554e35384ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:17:47.832615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-2cbd6d83-000a-4134-a23f-80eea2efdfa6 req-32961cae-15dc-4fc2-976d-b554e35384ce service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:47.833095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-2cbd6d83-000a-4134-a23f-80eea2efdfa6 req-32961cae-15dc-4fc2-976d-b554e35384ce service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:47.833537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-2cbd6d83-000a-4134-a23f-80eea2efdfa6 req-32961cae-15dc-4fc2-976d-b554e35384ce service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:47.850316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-2cbd6d83-000a-4134-a23f-80eea2efdfa6 req-32961cae-15dc-4fc2-976d-b554e35384ce service nova] Creating event network-changed:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:17:47.862993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-2cbd6d83-000a-4134-a23f-80eea2efdfa6 req-32961cae-15dc-4fc2-976d-b554e35384ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051836 Sep 13 14:17:47.867047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 445/823] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:47.989764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:47.992549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:47.999782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:48.000526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:48.001120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:48.002030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:48.002631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:48.003205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:48.045519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5558930e-89d8-49b1-896a-e652c7355eb9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060655 Sep 13 14:17:48.047060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 379/824] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:48.793430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:48.796595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:48.802724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:48.803212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:48.803647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:48.804346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:48.804801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:48.805227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:48.830498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:48.835928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1786e375-9ee5-4e82-b2f0-6888123b5f0d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047422 Sep 13 14:17:48.836495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 446/825] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:49.058602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:49.060890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:49.069161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.069941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.070539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.071734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.072408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.072620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.107703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1e4c90d-4289-43ee-8a35-18166b06eed4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053114 Sep 13 14:17:49.113162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 380/826] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:49.429233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:49.429750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:49.436217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.436691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.437151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.437869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.438321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.438743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.582572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lazy-loading 'services' on Instance uuid 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:17:49.657239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d60a324-76c8-4642-be50-d7670beb2c99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments/d529c02d-aec4-4c38-85be-cf364eeb2bd6" status: 202 len: 0 microversion: 2.1 time: 0.232109 Sep 13 14:17:49.657860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 447/827] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 13 14:17:49 2022] DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments/d529c02d-aec4-4c38-85be-cf364eeb2bd6 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:17:49.666229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:49.668368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:49.675389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.675869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.676349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.677096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.677592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.678263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.711587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa74cff0-ef48-407f-916e-ebacdca5013b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049319 Sep 13 14:17:49.712271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 381/828] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:17:49.851081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:49.853400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:49.859635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.860119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.860551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.861241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.861689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.862127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.901453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bb44c8f0-583b-486d-ae7b-b014c0c99cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056234 Sep 13 14:17:49.907410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 448/829] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:49.938498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-342339d6-91a2-433b-a2d4-78c755655982 req-44c9eb2d-21fb-4088-890e-00325346aebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:17:49.947593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-342339d6-91a2-433b-a2d4-78c755655982 req-44c9eb2d-21fb-4088-890e-00325346aebe service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:49.948058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-342339d6-91a2-433b-a2d4-78c755655982 req-44c9eb2d-21fb-4088-890e-00325346aebe service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:49.948477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-342339d6-91a2-433b-a2d4-78c755655982 req-44c9eb2d-21fb-4088-890e-00325346aebe service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:49.959943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-342339d6-91a2-433b-a2d4-78c755655982 req-44c9eb2d-21fb-4088-890e-00325346aebe service nova] Creating event network-changed:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:17:49.964952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-342339d6-91a2-433b-a2d4-78c755655982 req-44c9eb2d-21fb-4088-890e-00325346aebe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089346 Sep 13 14:17:49.966519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 382/830] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:50.120647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:50.124094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:50.130071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:50.130791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:50.131780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:50.132484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:50.133097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:50.133641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:50.176368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-868d8173-82c2-486f-b0b5-8be3b7943347 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059658 Sep 13 14:17:50.181017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 449/831] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:50.726218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:50.728419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:50.734509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:50.734984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:50.735407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:50.736089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:50.736535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:50.736950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:50.766893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89e695cf-2500-489c-88f6-51f71b46d05e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045454 Sep 13 14:17:50.767447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 383/832] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:50.914558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:50.916996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:50.923836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:50.924398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:50.924906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:50.925669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:50.926220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:50.926714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:50.956679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1cb8385a-8fc6-4438-b4fd-0dc3cf54f306 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045969 Sep 13 14:17:50.957225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 450/833] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:51.188765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:51.190829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:51.196644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:51.197116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:51.197543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:51.198244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:51.198780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:51.199197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:51.228681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e60ff7f-826e-421a-a5c2-2ea19b8a3113 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Sep 13 14:17:51.229241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 384/834] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:51.779556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:51.781639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:51.787615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:51.788095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:51.788524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:51.789200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:51.789649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:51.790089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:51.818295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca894dec-5082-4718-a268-ad49867a5c12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 Sep 13 14:17:51.818827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 451/835] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:51.968454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:51.970635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:51.973405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:17:51.973553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:17:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:17:51.979839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:51.980336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:51.980755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:51.981450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:51.981933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:51.982359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:52.013436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c029af4a-9742-42ff-a8b1-6987cbae1d0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048942 Sep 13 14:17:52.014243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 385/836] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:52.242226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:52.244356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:52.251185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:52.251658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:52.252092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:52.252771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:52.253218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:52.253634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:52.283860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-63116ae9-1c4c-4131-8af7-229818f5ab9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045651 Sep 13 14:17:52.284423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 452/837] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:52.831547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:52.833581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:52.839464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:52.839933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:52.840359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:52.841036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:52.841483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:52.842581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:52.870388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee35d955-ca64-45dd-a1c4-7f358bf8cab8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Sep 13 14:17:52.870926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 386/838] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:53.026047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:53.028250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:53.034618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:53.034935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:53.035368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:53.036063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:53.036516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:53.036938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:53.071165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69cd17c8-6fe5-447b-830c-f3e564029118 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049036 Sep 13 14:17:53.071720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 453/839] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:53.296619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:53.298900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:53.304993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:53.305476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:53.305955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:53.306690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:53.307151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:53.307581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:53.339815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acc1434a-4cb2-41eb-836d-29d6178e0d42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047334 Sep 13 14:17:53.340393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 387/840] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:53.882208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:53.884339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:53.891866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:53.892340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:53.892769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:53.893502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:53.894233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:53.894706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:53.923030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fbb37c2c-feff-4714-95d5-193c0dadd228 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Sep 13 14:17:53.923566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 454/841] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:54.083835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:54.086143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:54.092773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:54.093407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:54.093864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:54.094558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:54.095006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:54.095425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:54.125605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a351055-4d71-43d8-840d-3ff91df244b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045910 Sep 13 14:17:54.126178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 388/842] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:54.352599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:54.354815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:54.360893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:54.361382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:54.361872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:54.362580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:54.363031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:54.363461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:54.394663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a2798947-8180-4131-86c3-b585be4907dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046147 Sep 13 14:17:54.395216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 455/843] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:54.936978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:54.939141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:54.945497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:54.946004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:54.946432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:54.947110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:54.947587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:54.948001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:54.951838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:54.976898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-761e92d8-096a-4728-b0db-3bb8e9c2fabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Sep 13 14:17:54.977444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 389/844] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:55.137907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:55.140469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:55.147034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:55.147594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:55.148015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:55.148694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:55.149140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:55.149556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:55.179376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-453f4529-bffe-4607-a377-10eb2a4ee2cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045379 Sep 13 14:17:55.179922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 456/845] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:55.407266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:55.409424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:55.415338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:55.415819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:55.416252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:55.416941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:55.417395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:55.417912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:55.447980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-871647b5-f752-498b-86bc-286fbc9ef8b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044721 Sep 13 14:17:55.448552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 390/846] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:55.988937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:55.991177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:55.997328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:55.997841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:55.998780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:55.999464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:56.000008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:56.000434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:56.031380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-303e11bd-e506-4205-8622-7b96930dc3dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Sep 13 14:17:56.031929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 457/847] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:56.191784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:56.194076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:56.200581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:56.201267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:56.202365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:56.203058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:56.203507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:56.203928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:56.233856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffb39479-6044-483f-8666-87b3c9df9a6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Sep 13 14:17:56.234413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 391/848] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:56.461123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:56.463357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:56.469842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:56.470327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:56.470761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:56.471453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:56.471906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:56.472329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:56.502442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-488a5107-d14f-4d31-a645-91ac8388caa3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045262 Sep 13 14:17:56.503001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 458/849] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:57.043907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:57.046442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:57.052393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:57.052875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:57.053312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:57.054028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:57.054488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:57.054912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:57.087114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02052d11-b66d-478d-8e1b-ef032950b894 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047186 Sep 13 14:17:57.088035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 392/850] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:57.250475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:57.252598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:57.258511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:57.258988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:57.259414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:57.260094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:57.260543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:57.260958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:57.291901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8f31f0fa-8782-4ef6-a939-0adbf89a1b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048617 Sep 13 14:17:57.292442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 459/851] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:57.515024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:57.517155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:57.524159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:57.524640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:57.525078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:57.525804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:57.526262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:57.526768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:57.556967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-496c2c2d-9a9e-42bf-9bad-8b32c9cf75f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045911 Sep 13 14:17:57.557530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 393/852] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:58.100147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:58.102298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:58.108838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:58.109312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:58.109760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:58.110453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:58.110898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:58.111314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:58.139790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-304cb5af-4f6e-4e09-a630-bf8b8df2ecbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Sep 13 14:17:58.140329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 460/853] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:58.304409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:58.306606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:58.312959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:58.313444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:58.313924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:58.314597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:58.315054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:58.315480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:58.345672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47a54c38-4e11-42b7-8a52-c172fb63ef4e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Sep 13 14:17:58.346251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 394/854] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:58.569573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:58.571716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:58.578325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:58.578804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:58.579232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:58.579918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:58.580361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:58.580776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:58.610403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f010eba-b371-45bb-80fd-77657c5f0256 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Sep 13 14:17:58.610952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 461/855] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:17:59.152626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:59.155169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:59.161454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:59.161963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:59.162388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:59.163072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:59.163546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:59.163982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:59.192977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b4669a5-7314-4dc0-88f5-c89a5b796a3f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Sep 13 14:17:59.193518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 395/856] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:59.358427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:59.360592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:59.367018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:59.367496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:59.368255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:59.368729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:59.369060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:59.369477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:59.395683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:17:59.400835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-614aa2a2-48ce-40de-995a-dc108eb2d57e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047001 Sep 13 14:17:59.401388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 462/857] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:17:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:17:59.622769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:17:59.625898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:17:59.631863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:59.632346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:59.632783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:59.633472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:17:59.633964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:17:59.634391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:17:59.663629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86567211-f168-42d7-8963-f53c5bf417cc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044957 Sep 13 14:17:59.664184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 396/858] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:17:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:00.206086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:00.208310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:00.214533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:00.215018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:00.215453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:00.216139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:00.216600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:00.217762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:00.245794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c8865cb6-ad11-4923-be69-089bbe5cf8ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044921 Sep 13 14:18:00.246352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 463/859] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:00.412779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:00.414941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:00.421431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:00.421956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:00.422385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:00.423077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:00.423514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:00.423930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:00.457126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98acf94a-9f31-4664-86c8-d18d69672c30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048262 Sep 13 14:18:00.457634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 397/860] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:00.676171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:00.678322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:00.684531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:00.685003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:00.686002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:00.686707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:00.687158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:00.687574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:00.716310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6751c7ed-aa60-4b3e-9b0b-d96760997267 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044063 Sep 13 14:18:00.716822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 464/861] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:01.258519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:01.260655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:01.266809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:01.267289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:01.267720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:01.268406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:01.269108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:01.269536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:01.298756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b8173ef-ecbc-4168-857f-82fd204b3616 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 Sep 13 14:18:01.299302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 398/862] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:01.469157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:01.471422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:01.477382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:01.477898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:01.478328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:01.479011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:01.479456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:01.479873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:01.509862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-254468d0-2b54-44c4-bf91-6ccf6eefdc97 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Sep 13 14:18:01.510365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 465/863] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:01.728497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:01.730647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:01.737095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:01.737568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:01.738047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:01.738722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:01.739174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:01.739594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:01.769387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f4db2e0-c996-4e54-bcd2-a4294d9ac833 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044543 Sep 13 14:18:01.769891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 399/864] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:02.311931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:02.314097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:02.320501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:02.320978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:02.321403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:02.322109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:02.322559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:02.322978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:02.351580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bc58c6cf-97d8-4499-b52a-fe25f60d52b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044385 Sep 13 14:18:02.352129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 466/865] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:02.522840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:02.524991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:02.534469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:02.534957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:02.535385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:02.536078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:02.536525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:02.537056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:02.567521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d600526-490d-4085-9c94-dca15efe92d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049166 Sep 13 14:18:02.568168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 400/866] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:02.782565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:02.784676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:02.790923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:02.791397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:02.791840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:02.792498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:02.792945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:02.793358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:02.822635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ebe35edf-80d5-47bb-beac-084deae2ac47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Sep 13 14:18:02.823112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 467/867] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:03.363755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:03.365933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:03.372359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:03.372860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:03.373296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:03.374161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:03.374617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:03.375046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:03.403808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b60a1b9-e159-43b4-9e3d-3e7382be780b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Sep 13 14:18:03.405164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 401/868] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:03.580983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:03.583231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:03.585827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=76 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:03.591599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:03.593524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:03.594018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:03.594730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:03.595213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:03.595637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:03.626765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-032328dd-2b31-4ab0-98c4-c506d14c0ac9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049698 Sep 13 14:18:03.627321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 468/869] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:03.834518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:03.836684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:03.842751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:03.843224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:03.843651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:03.844339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:03.844815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:03.845228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:03.874982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8b70826-925c-46c2-9913-44b37d881cd9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044498 Sep 13 14:18:03.875468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 402/870] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:04.416595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:04.418785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:04.425624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:04.426144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:04.426583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:04.427272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:04.427736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:04.428160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:04.457289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-235c7041-a854-41f0-808d-b630f61a1016 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Sep 13 14:18:04.457866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 469/871] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:04.639602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:04.641863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:04.648571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:04.649052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:04.649484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:04.650204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:04.650656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:04.651079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:04.681597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d5f06978-a8b0-4ddd-9721-ce03e0a696c3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046534 Sep 13 14:18:04.682188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 403/872] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:04.887464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:04.890454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:04.897052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:04.897531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:04.897998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:04.898683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:04.899141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:04.899561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:04.928782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-142daea1-65c4-48f4-b6a1-f06e743fb632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045398 Sep 13 14:18:04.929324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 470/873] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:05.470051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:05.472200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:05.478381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:05.478868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:05.479306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:05.480005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:05.480461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:05.480886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:05.510475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2be4b05f-6832-485a-843a-ddfc420b7dfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Sep 13 14:18:05.511020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 404/874] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:05.693680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:05.695865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:05.702502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:05.702983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:05.703410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:05.704097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:05.704546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:05.704965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:05.735113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c86e6be3-7d0d-484d-a072-6075ea2a5772 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Sep 13 14:18:05.735858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 471/875] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:05.941439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:05.943595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:05.950021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:05.950497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:05.950985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:05.951790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:05.952240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:05.952757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:05.977677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:05.983817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24b7db69-a887-46e1-a29c-239bead90b83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046350 Sep 13 14:18:05.984369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 405/876] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:06.523775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:06.525986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:06.532487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:06.532969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:06.533400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:06.534122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:06.534579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:06.534999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:06.565347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a0c480dc-16c8-4c62-b399-d6f700165744 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Sep 13 14:18:06.566303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 472/877] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:06.747540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:06.750221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:06.756500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:06.756982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:06.757438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:06.758149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:06.758600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:06.759049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:06.789443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8179ea94-6074-4aa8-af14-58b17dd07719 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Sep 13 14:18:06.790048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 406/878] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:06.996333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:06.999013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:07.004877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:07.005354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:07.005819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:07.006502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:07.006956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:07.007380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:07.036883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-718e716f-8d71-4909-a7de-61a059f01ba7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044583 Sep 13 14:18:07.037426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 473/879] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:07.577856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:07.580047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:07.582561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=78 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:07.587674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:07.588146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:07.588570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:07.589251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:07.589697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:07.590137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:07.619744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a82ed03a-e42b-4860-b136-2cab5bff191c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Sep 13 14:18:07.620286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 407/880] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:07.801821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:07.803923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:07.810755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:07.811110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:07.811542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:07.812235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:07.812682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:07.813099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:07.844666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d7c1bb2-58dd-4d8f-bd90-c0723d9ff5c5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Sep 13 14:18:07.845231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 474/881] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:08.049246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:08.051368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:08.057285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:08.057797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:08.058262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:08.058993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:08.059446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:08.059870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:08.100175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d38ed003-1ec6-4d1c-ab0c-547a231b251d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055069 Sep 13 14:18:08.100736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 408/882] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:08.632227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:08.634430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:08.640390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:08.640869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:08.641305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:08.642022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:08.642475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:08.642896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:08.671677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-854c1eb4-e66b-45f3-ba79-763ac1047f9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Sep 13 14:18:08.672214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 475/883] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:08.856365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:08.859216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:08.866085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:08.866569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:08.867000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:08.867692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:08.868163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:08.868546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:08.898200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6827ae4a-f34b-43dd-90ca-b30baa571d06 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Sep 13 14:18:08.898665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 409/884] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:09.112798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:09.114915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:09.121209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:09.121691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:09.122158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:09.122844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:09.123302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:09.123805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:09.152972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9399bbea-3a94-40a6-b8b1-15ed1477b8f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044192 Sep 13 14:18:09.153520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 476/885] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:09.683197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:09.685311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:09.691819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:09.692288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:09.692712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:09.693391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:09.693861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:09.694277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:09.723088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1201fd24-9a78-49c9-bf46-03391365b38d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Sep 13 14:18:09.723633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 410/886] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:09.910289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:09.912422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:09.918384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:09.918864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:09.919300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:09.919985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:09.921034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:09.921512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:09.953204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b141711-be90-4b5c-9acb-88f38d4f852e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Sep 13 14:18:09.953783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 477/887] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:10.165473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:10.167603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:10.174695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:10.175167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:10.175594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:10.176277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:10.176724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:10.177142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:10.206905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e61b640-1159-4c74-ac1f-8029cafd071e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045427 Sep 13 14:18:10.207452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 411/888] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:10.735629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:10.737830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:10.744135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:10.744616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:10.745047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:10.745756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:10.746225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:10.746648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:10.775656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5155d663-4c1e-4557-999d-ee318823ec1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Sep 13 14:18:10.776198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 478/889] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:10.965692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:10.968647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:10.974647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:10.975035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:10.975473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:10.976176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:10.976632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:10.977084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:11.008040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dca7e785-cef6-495a-80f9-df6c544e223b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Sep 13 14:18:11.008615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 412/890] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:11.219522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:11.221647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:11.227595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:11.228071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:11.228499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:11.229178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:11.229622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:11.230059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:11.247105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:11.261073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f29fbbe7-7a3f-4567-9c9b-c2d8bb8dbc9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045655 Sep 13 14:18:11.261625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 479/891] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:11.789068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:11.791158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:11.798277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:11.798755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:11.799188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:11.799873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:11.800324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:11.800743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:11.829012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6152e2e-c0b7-446b-83e7-a46ae70b774c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044060 Sep 13 14:18:11.829561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 413/892] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:12.020671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:12.022831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:12.029135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:12.030136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:12.030568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:12.031249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:12.031698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:12.032114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:12.062673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4a4d6808-2de1-49e1-854a-2d0c6a8465d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Sep 13 14:18:12.063248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 480/893] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:12.274610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:12.276792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:12.283682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:12.284161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:12.284597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:12.285288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:12.285767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:12.286198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:12.315476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1ce25a3-bfaa-4c13-9238-aef4a987a223 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044787 Sep 13 14:18:12.315958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 414/894] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:12.842723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:12.844876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:12.850791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:12.851264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:12.851692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:12.852365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:12.852811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:12.853230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:12.881977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0782b53b-2bec-42cb-b688-6f0c792e40c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Sep 13 14:18:12.882510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 481/895] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:13.075033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:13.077347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:13.083655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:13.084130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:13.084583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:13.085265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:13.085711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:13.086147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:13.130951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a7bc06a-c0e1-45e6-b8e3-b677ceb17ee7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059830 Sep 13 14:18:13.131540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 415/896] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:13.328221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:13.330412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:13.336729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:13.337219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:13.337658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:13.338378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:13.338839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:13.339266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:13.369798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47427da5-8633-443f-832f-bc6a0f210c6b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045732 Sep 13 14:18:13.370310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 482/897] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:13.894555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:13.896676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:13.902817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:13.903327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:13.903756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:13.904551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:13.905035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:13.905486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:13.934482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd40c0f1-7d61-4b70-b95c-a0dde333fe61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Sep 13 14:18:13.935068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 416/898] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:14.145756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:14.148716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:14.155601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:14.156296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:14.156746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:14.157452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:14.158146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:14.158812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:14.203223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-567a88cf-7d42-4e6b-82ad-19f6410c4d45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062908 Sep 13 14:18:14.203902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 483/899] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:14.382124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:14.384238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:14.391182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:14.391662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:14.392098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:14.392788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:14.393238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:14.394016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:14.423121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de72c0b0-1446-4d0b-82c3-102e31745083 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045076 Sep 13 14:18:14.423685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 417/900] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:14.947725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:14.949914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:14.956905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:14.957381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:14.957839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:14.958519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:14.958965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:14.959380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:14.987398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f98367b4-1adb-4faf-b962-96d3cf3ff85f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Sep 13 14:18:14.987928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 484/901] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:15.215822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:15.218258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:15.224132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:15.224681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:15.225020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:15.225703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:15.226177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:15.226595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:15.258285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e19c253b-6c5c-4646-b19f-e5c0b6e0cbe6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Sep 13 14:18:15.258846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 418/902] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:15.436181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:15.438344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:15.444191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:15.444672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:15.445103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:15.445817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:15.446270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:15.446695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:15.476147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e26e6321-8c71-4368-8ee2-b7c6ac2aaf20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044478 Sep 13 14:18:15.476621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 485/903] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:16.000393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:16.002613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:16.010059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:16.010536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:16.010973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:16.011662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:16.012108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:16.012524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:16.042434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0d1d513-1b6b-4231-a659-c02bf86e12da tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Sep 13 14:18:16.042992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 419/904] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:16.270776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:16.272922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:16.278916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:16.279966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:16.280399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:16.281086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:16.281532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:16.281979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:16.312388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ed4f724-cd0f-4469-a40b-40450a9ff2df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Sep 13 14:18:16.312947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 486/905] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:16.489488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:16.491669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:16.497486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:16.498008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:16.498443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:16.499317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:16.499773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:16.500198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:16.530938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cf32739-a6ba-4c0d-b586-520a16e884f2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045350 Sep 13 14:18:16.531515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 420/906] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:18:17.054932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:17.057089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:17.063079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:17.063557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:17.063987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:17.064666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:17.065112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:17.065527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:17.093390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e096f452-dd4d-4bf3-b251-db1f13b1b2b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042369 Sep 13 14:18:17.093958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 487/907] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:17.324808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:17.327853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:17.334400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:17.334885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:17.335320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:17.336013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:17.336467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:17.336890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:17.372322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fad79dd-5691-46ae-8d8a-ef3235d708f8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051010 Sep 13 14:18:17.374560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 421/908] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:17.543431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:17.545737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:17.552216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:17.552696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:17.553172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:17.553893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:17.554351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:17.554775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:17.584496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1daf03a4-4092-4be8-8e29-e762d45e2292 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044994 Sep 13 14:18:17.584972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 488/909] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:18.105515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:18.108248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:18.114307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:18.114838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:18.115274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:18.115962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:18.116413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:18.116834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:18.134016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:18.147551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45983ad5-4148-423a-bf2d-9d1af394901f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 Sep 13 14:18:18.148106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 422/910] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:18.384275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:18.386425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:18.392622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:18.393102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:18.393853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:18.394557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:18.395041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:18.395521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:18.437683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8ccf0e9-6dc9-4dcb-9e2c-eb8ec9e4f21f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057250 Sep 13 14:18:18.438274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 489/911] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:18.596834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:18.599038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:18.605355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:18.605874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:18.606307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:18.606992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:18.607449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:18.607873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:18.636959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8948cfc-513d-4278-871e-c3355c78d098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044023 Sep 13 14:18:18.637435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 423/912] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:18:19.160651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:19.162858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:19.169239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:19.169776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:19.170405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:19.171089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:19.171542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:19.171961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:19.199917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e43ea94f-85da-43fe-8bfa-61ab1bc32805 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 Sep 13 14:18:19.200467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 490/913] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:19.449169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:19.452151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:19.458331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:19.458811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:19.459238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:19.459929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:19.460374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:19.460917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:19.491921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e72076d0-e35d-42f0-9575-f7e0744625f4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 Sep 13 14:18:19.492641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 424/914] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:19.650431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:19.652709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:19.658868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:19.659348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:19.659780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:19.660463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:19.660955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:19.661373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:19.690758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d8aa6e5a-1307-49d7-980e-3ee71062faa7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044286 Sep 13 14:18:19.691241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 491/915] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:20.212890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:20.215054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:20.223028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:20.223499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:20.223925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:20.224609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:20.225053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:20.225467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:20.254245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1dc845de-7e22-4c32-9505-16bfdef384bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Sep 13 14:18:20.254796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 425/916] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:20.504704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:20.507683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:20.514869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:20.515457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:20.515889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:20.516579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:20.517030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:20.517445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:20.558949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56eb6b5a-e1bf-4657-a35a-6ed41d42c3ee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058151 Sep 13 14:18:20.559844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 492/917] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:20.703975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:20.706125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:20.712171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:20.712655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:20.713085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:20.713794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:20.714244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:20.714663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:20.744354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55376d8b-ef85-47e8-aed1-6c47fd6555cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045104 Sep 13 14:18:20.744916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 426/918] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:21.266780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:21.269182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:21.275095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:21.275570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:21.276003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:21.276685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:21.277138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:21.277559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:21.306070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b138a346-1ee4-4be9-ab81-22d4f7b38a90 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043229 Sep 13 14:18:21.306621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 493/919] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:21.571317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:21.574731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:21.582071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:21.582549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:21.583182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:21.583883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:21.584337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:21.584757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:21.615365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15871fdd-43aa-4502-b8ca-9a3cba7612a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047958 Sep 13 14:18:21.615937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 427/920] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:21.757170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:21.759418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:21.766588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:21.767074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:21.767508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:21.768202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:21.768913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:21.769333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:21.798340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-845d61ef-cd43-4268-a3c2-0646c4c13427 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045020 Sep 13 14:18:21.798817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 494/921] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:22.318706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:22.320809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:22.326917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:22.327393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:22.327825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:22.328508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:22.328959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:22.329381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:22.359188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0cfd201-1046-441f-ad2d-2910fb3ff4aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Sep 13 14:18:22.359754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 428/922] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:22.627937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:22.630129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:22.635985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:22.636472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:22.636908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:22.637630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:22.638120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:22.639114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:22.669182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-75557282-025d-4362-b11d-fedb7604e573 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Sep 13 14:18:22.669789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 495/923] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:22.809971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:22.812282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:22.818568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:22.819043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:22.819470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:22.820149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:22.820595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:22.821011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:22.850588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c99f528-20f6-4c7c-b2dd-7c0c967f8812 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044588 Sep 13 14:18:22.851126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 429/924] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:23.371658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:23.374450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:23.380777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:23.381251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:23.381683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:23.382375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:23.382821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:23.383236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:23.386855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:23.411869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9520ad6b-5ba1-4868-b0dc-189eb9a634b7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Sep 13 14:18:23.412418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 496/925] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:23.681208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:23.683446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:23.690247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:23.690726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:23.691155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:23.691846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:23.692296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:23.692716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:23.726598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d68bc2d6-27a0-4640-b9bf-21e2f74064e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045537 Sep 13 14:18:23.726598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 430/926] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:23.864041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:23.866218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:23.872018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:23.872491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:23.873053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:23.873870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:23.874324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:23.874743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:23.904577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4cbba756-5724-411f-b258-dcb7c2198567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043952 Sep 13 14:18:23.905256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 497/927] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:24.425136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:24.427344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:24.433220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:24.433698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:24.434163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:24.434848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:24.435883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:24.436310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:24.464981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32814f4c-a46d-4b4d-9e54-bb2ff9846d59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043836 Sep 13 14:18:24.465548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 431/928] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:24.734672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:24.736858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:24.743244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:24.743722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:24.744161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:24.744887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:24.745337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:24.745772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:24.776420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-631962a2-6814-46a7-8add-62c71fd13c01 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Sep 13 14:18:24.776979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 498/929] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:24.917400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:24.920211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:24.926585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:24.927056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:24.927481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:24.928159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:24.928607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:24.929029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:24.958198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85605074-3ecb-428d-8fef-523bb7678999 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044773 Sep 13 14:18:24.958736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 432/930] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:25.478983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:25.481179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:25.487363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:25.487841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:25.488282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:25.488968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:25.489417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:25.489870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:25.520341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42fc761e-6612-4ecd-9556-aa5a4022767a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Sep 13 14:18:25.521124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 499/931] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:25.789418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:25.791556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:25.798143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:25.798615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:25.799040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:25.799719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:25.800166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:25.800581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:25.831029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-389aa873-2edf-46e3-be28-7bf546a27565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Sep 13 14:18:25.831592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 433/932] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:25.971195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:25.973314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:25.979678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:25.980190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:25.980619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:25.981300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:25.981815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:25.982857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:26.010889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-40ab327a-7ff4-4f47-86e2-8be49895e502 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044302 Sep 13 14:18:26.011420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 500/933] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:26.533244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:26.535519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:26.541871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:26.542343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:26.542767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:26.543443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:26.543891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:26.544306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:26.573294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71fd5096-0826-48d3-b560-6ca168680dd6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Sep 13 14:18:26.573867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 434/934] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:26.843389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:26.845443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:26.851381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:26.851863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:26.852296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:26.853461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:26.853461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:26.853855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:26.884065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-376a9a85-3736-4b05-ad7d-c2b62b1526fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Sep 13 14:18:26.884624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 501/935] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:27.023502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:27.025632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:27.031627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:27.032100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:27.032524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:27.033202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:27.033647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:27.034086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:27.062937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82b5e095-5f1d-4e59-9be3-1a1af52256b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043372 Sep 13 14:18:27.063517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 435/936] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:27.586190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:27.588392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:27.594847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:27.595319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:27.595748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:27.596424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:27.596871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:27.597287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:27.625859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-66c3d9b6-595d-4dac-a967-a212c994ad7a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Sep 13 14:18:27.626404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 502/937] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:27.896749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:27.899008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:27.905407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:27.905921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:27.906347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:27.907027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:27.907471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:27.907888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:27.938730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5213967-ed46-4b3b-a88f-198fc3cb6490 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046152 Sep 13 14:18:27.939294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 436/938] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:28.075418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:28.077649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:28.083593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:28.084078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:28.084518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:28.085205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:28.085663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:28.086112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:28.114914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b80b1db3-9329-42df-a84c-03a744e0cc60 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043499 Sep 13 14:18:28.115460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 503/939] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:28.638483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:28.641131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:28.647416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:28.647885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:28.648309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:28.648983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:28.649429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:28.649875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:28.679303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03263049-5047-40d2-b41c-248afb4f2ed5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Sep 13 14:18:28.679852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 437/940] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:28.950771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:28.953510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:28.959913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:28.960394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:28.960827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:28.961515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:28.961997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:28.962423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:28.991482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d5a6c32d-9b32-4106-a57e-47b4cbeb153b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Sep 13 14:18:28.992039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 504/941] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:29.127817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:29.130042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:29.136361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:29.136836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:29.137267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:29.138084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:29.138542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:29.139729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:29.168875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9930fa1c-0c83-4f12-902e-46693aa9d059 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045573 Sep 13 14:18:29.169435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 438/942] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:29.692644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:29.694752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:29.700643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:29.701117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:29.701571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:29.702267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:29.702717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:29.703137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:29.731342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-95281036-a3c8-423d-a28b-226a967fa3bd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042783 Sep 13 14:18:29.731879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 505/943] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:30.003940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:30.006142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:30.012114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:30.012588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:30.013020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:30.013709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:30.014296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:30.014931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:30.018896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:30.047303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c093aa7a-4509-488a-9a31-f090f3c1106b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047307 Sep 13 14:18:30.047869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 439/944] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:30.181575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:30.183741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:30.190191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:30.190691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:30.191125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:30.191810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:30.192262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:30.192683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:30.222293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af352fae-dcb5-4658-b4d6-e5621f382950 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044715 Sep 13 14:18:30.222833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 506/945] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:30.743707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:30.745921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:30.752887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:30.753360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:30.753804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:30.754485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:30.754930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:30.755346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:30.784189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6e2920a-ab63-4b31-ae95-2b8082fcfd5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Sep 13 14:18:30.784731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 440/946] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:31.059712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:31.062095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:31.068163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:31.068641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:31.069070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:31.069768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:31.070221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:31.070641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:31.102562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c75e1591-268b-423b-9f73-cc8b7b195047 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046756 Sep 13 14:18:31.103316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 507/947] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:31.234887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:31.237012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:31.242847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:31.243318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:31.243792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:31.244424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:31.244870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:31.245290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:31.275194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31ebda48-0c6b-443b-825a-4f3469c3cd49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044413 Sep 13 14:18:31.275746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 441/948] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:31.797233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:31.799397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:31.805793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:31.806277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:31.806710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:31.807398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:31.807853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:31.808274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:31.837098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eda732d8-9fc0-4e92-bea7-f96af8c65b35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044412 Sep 13 14:18:31.837635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 508/949] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:32.115398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:32.117538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:32.124087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:32.124561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:32.124992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:32.125706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:32.126181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:32.126601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:32.157464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6a57b23-f3da-49e4-b2ed-14fcc17c5132 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Sep 13 14:18:32.158067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 442/950] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:32.287633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:32.289846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:32.296609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:32.297086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:32.297525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:32.298244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:32.298699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:32.299125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:32.330584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc1c4232-b5c7-4293-9299-ee3eeaa40abd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046913 Sep 13 14:18:32.331130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 509/951] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:32.849479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:32.851642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:32.857524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:32.858037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:32.858457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:32.859139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:32.859585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:32.860000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:32.888427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b9b01d4-49df-49aa-865a-f385d08873d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Sep 13 14:18:32.889630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 443/952] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:33.170029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:33.172661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:33.179051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:33.179530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:33.179964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:33.180655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:33.181136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:33.181554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:33.212359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a23279d3-13e5-477c-86c3-3c5fa26eb50e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Sep 13 14:18:33.212923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 510/953] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:33.343115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:33.345353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:33.351716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:33.352188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:33.352616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:33.353302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:33.353771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:33.354193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:33.384008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c15c16b0-83d4-4529-bd9c-37a0d7df8bab tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044949 Sep 13 14:18:33.384580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 444/954] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:33.901701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:33.903763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:33.906337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:33.911522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:33.911996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:33.912426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:33.913104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:33.913549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:33.913986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:33.941997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c348704-4312-4a02-b33a-8870dc0dd72c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Sep 13 14:18:33.942535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 511/955] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:34.224517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:34.226676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:34.232501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:34.233000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:34.233431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:34.234142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:34.234589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:34.235006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:34.266259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41cfb173-55c1-4ed2-b1c5-4769515f2576 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Sep 13 14:18:34.267000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 445/956] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:34.397027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:34.399193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:34.405433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:34.405957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:34.406393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:34.407077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:34.407539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:34.407961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:34.432375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:34.438242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-29ddef4f-3810-4869-97fd-44a3cbb28877 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045434 Sep 13 14:18:34.438795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 512/957] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:18:34.955163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:34.957283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:34.963722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:34.964195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:34.964621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:34.965302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:34.965771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:34.966191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:34.994305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c3acc88f-3b05-40fb-a792-9b16be8e9cb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Sep 13 14:18:34.994847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 446/958] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:35.278934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:35.281219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:35.287258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:35.287741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:35.288182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:35.289076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:35.289857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:35.290407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:35.322092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-799feb3c-99ab-4e87-923d-37c41b6c3f92 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Sep 13 14:18:35.322698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 513/959] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:35.450593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:35.452819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:35.459648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:35.460195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:35.460621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:35.461313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:35.461786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:35.462209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:35.493192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c02416ee-1c91-4ec7-b6ba-ab3959e5b9cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046509 Sep 13 14:18:35.493779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 447/960] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:18:36.006432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:36.008610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:36.015585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:36.016067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:36.016503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:36.017191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:36.017651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:36.018109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:36.046800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd157471-5364-4492-a99b-74adeea79434 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Sep 13 14:18:36.047414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 514/961] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:36.335105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:36.337244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:36.343866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:36.344342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:36.344776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:36.345493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:36.347177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:36.347771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:36.379406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a03e4355-d771-4b78-b3d7-6ce578d06dea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048438 Sep 13 14:18:36.379970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 448/962] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:18:36.505688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:36.507881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:36.514528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:36.515289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:36.515743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:36.516434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:36.516891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:36.517312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:36.546980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a383c5d8-c318-4ec8-b67e-9cf77023e2e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045315 Sep 13 14:18:36.547545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 515/963] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:37.059535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:37.062376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:37.068360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:37.068839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:37.069273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:37.069989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:37.070446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:37.070867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:37.099260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5741069c-375b-4939-8a6a-3522314248ab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Sep 13 14:18:37.099812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 449/964] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:37.392380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:37.394753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:37.401182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:37.401659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:37.402133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:37.402819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:37.403271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:37.403692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:37.433639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0137767-8af1-4ff5-858f-f9c8decbbba2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Sep 13 14:18:37.434304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 516/965] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:37.559564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:37.561767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:37.568100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:37.568582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:37.569010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:37.569697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:37.570172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:37.570593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:37.600150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce04e7b6-3884-4dc5-a3ff-f680c602b29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044548 Sep 13 14:18:37.600705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 450/966] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:38.111990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:38.114073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:38.119963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:38.120444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:38.120874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:38.121559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:38.122041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:38.122462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:38.151682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d39183ff-4d88-4d8d-a14f-927b8a697eae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Sep 13 14:18:38.152230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 517/967] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:38.446095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:38.448192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:38.450062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=88 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:38.455229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:38.455705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:38.456137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:38.456821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:38.457270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:38.457694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:38.487616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c9d0fcba-2a48-426b-813a-819d0105220c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045565 Sep 13 14:18:38.488228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 451/968] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:38.613175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:38.615438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:38.621986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:38.622467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:38.622902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:38.624190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:38.624708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:38.625135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:38.653964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bb483a20-1580-4918-9b2c-90494dd16c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044721 Sep 13 14:18:38.654511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 518/969] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:39.164245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:39.166314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:39.172846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:39.173317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:39.173766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:39.174448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:39.174897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:39.175316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:39.203838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2234be46-048e-4b75-b6cd-d60538f53760 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043577 Sep 13 14:18:39.204373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 452/970] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:39.500384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:39.502557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:39.508531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:39.509008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:39.509435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:39.510136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:39.510585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:39.511001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:39.541089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c4e76e2-a339-4009-8683-ec198f36a8a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Sep 13 14:18:39.541635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 519/971] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:39.666098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:39.668234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:39.674413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:39.674886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:39.675315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:39.676004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:39.676454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:39.676875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:39.706685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-962576be-ba37-4550-a23a-409ff3637a73 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044492 Sep 13 14:18:39.707231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 453/972] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:40.216200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:40.218399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:40.224820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:40.225302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:40.225782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:40.226474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:40.226929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:40.227353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:40.255920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-217bebe3-0608-4c2b-b05f-12e6d564f9df tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 Sep 13 14:18:40.256489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 520/973] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:40.552971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:40.555145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:40.562245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:40.562724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:40.563155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:40.563843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:40.564296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:40.564718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:40.593558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd70e3e1-e541-4c5f-ac18-e5aaaf33cf27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044516 Sep 13 14:18:40.594131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 454/974] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:40.719258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:40.721386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:40.727295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:40.727775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:40.728209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:40.728887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:40.729337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:40.729775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:40.759459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-009235ca-71bd-4ffd-9236-1ddb5728a4b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044581 Sep 13 14:18:40.759997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 521/975] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:41.268281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:41.270731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:41.276651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:41.277130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:41.277565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:41.278273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:41.278730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:41.279657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:41.304525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:41.309576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1edd8be8-4f69-4806-94d5-6f6343906e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 Sep 13 14:18:41.310156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 455/976] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:41.606280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:41.608500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:41.615087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:41.615576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:41.616012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:41.616732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:41.617189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:41.617614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:41.647045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d8df3c4-5a91-403f-814c-ae29e3872a24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Sep 13 14:18:41.647606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 522/977] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:41.772691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:41.774917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:41.781213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:41.781627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:41.782089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:41.782769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:41.783215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:41.783629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:41.812536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b403d564-3a0a-4ca6-83f5-e9cbb3f5e205 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044235 Sep 13 14:18:41.813076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 456/978] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:42.322142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:42.324196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:42.330129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:42.330605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:42.331031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:42.331706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:42.332155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:42.332569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:42.361020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e60f2855-d1dc-4cb0-900a-53cb1c461edb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 Sep 13 14:18:42.361571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 523/979] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:42.660216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:42.662390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:42.668353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:42.668832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:42.669267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:42.670715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:42.671179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:42.671604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:42.700067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6bb2ac3-4311-42a9-b40b-a508e00b0227 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Sep 13 14:18:42.700614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 457/980] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:42.824384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:42.827059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:42.833239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:42.833714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:42.834172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:42.834850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:42.835298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:42.835715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:42.864402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-791b13b7-b138-4117-a70e-9489613a932a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043957 Sep 13 14:18:42.864934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 524/981] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:43.374396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:43.376431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:43.382889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:43.383359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:43.383785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:43.384465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:43.384909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:43.385324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:43.414438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bba5559-5b6c-4065-b2e9-dcfee3648f35 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Sep 13 14:18:43.414979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 458/982] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:43.712673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:43.714845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:43.721035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:43.721514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:43.721986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:43.722682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:43.723140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:43.723566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:43.753844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d61ffd4-d46d-4e95-b7b9-93691e634e68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Sep 13 14:18:43.754393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 525/983] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:43.877942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:43.880082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:43.885956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:43.886436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:43.886861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:43.887540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:43.887987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:43.888416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:43.917202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-941d2de2-3109-4b97-962e-33e6cb69a281 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044273 Sep 13 14:18:43.917752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 459/984] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:18:44.426214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:44.428260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:44.434558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:44.435031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:44.435493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:44.436271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:44.436720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:44.437138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:44.465434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-34c5cd24-654f-452a-a385-d8fdb218119c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043347 Sep 13 14:18:44.466015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 526/985] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:44.766382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:44.768790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:44.775098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:44.775569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:44.775993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:44.776669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:44.777113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:44.777523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:44.807306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10a592bf-c337-467a-85f9-dd250e822b94 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Sep 13 14:18:44.807850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 460/986] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:44.930104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:44.932273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:44.938094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:44.938573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:44.939005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:44.939693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:44.940143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:44.940561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:44.969178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-85565ba7-2750-4d33-a723-62e50b007dda tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043080 Sep 13 14:18:44.969718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 527/987] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:45.478710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:45.480905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:45.487024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:45.487502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:45.487933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:45.488618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:45.489070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:45.489488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:45.519251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0d05345-f5ee-4198-a343-2846d90edd63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Sep 13 14:18:45.519804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 461/988] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:45.819876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:45.821994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:45.828481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:45.828958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:45.829388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:45.830103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:45.830551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:45.830967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:45.861205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-818bd49d-95e0-4f2f-83ef-f88addd9c62c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Sep 13 14:18:45.861771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 528/989] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:45.981530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:45.983693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:45.990070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:45.990532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:45.990967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:45.991649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:45.992101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:45.992520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:46.022526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f82b050-aad0-468b-9178-94ad13789098 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044878 Sep 13 14:18:46.023246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 462/990] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:46.532824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:46.535040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:46.540983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:46.541465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:46.541935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:46.542622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:46.543072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:46.543493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:46.560471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:46.573508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa73ba1c-5bbb-45a6-b26b-8cc919c0c0ea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Sep 13 14:18:46.574085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 529/991] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:46.873481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:46.875684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:46.881625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:46.882117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:46.882550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:46.883239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:46.883687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:46.884108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:46.914379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f4c9dff3-f511-4cd3-9096-25823f231f76 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Sep 13 14:18:46.914924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 463/992] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:47.034576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:47.036714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:47.042558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:47.043039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:47.043501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:47.044184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:47.044636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:47.045059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:47.073632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1c0e8063-b819-4fc7-8279-8045d9a033fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043071 Sep 13 14:18:47.074210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 530/993] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:47.586875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:47.588922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:47.595270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:47.595742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:47.596167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:47.596848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:47.597295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:47.597711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:47.626808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17d3e9e4-49b3-479e-8d75-35fb941d12c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044144 Sep 13 14:18:47.627362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 464/994] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:47.927461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:47.929560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:47.935967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:47.936449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:47.937098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:47.937822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:47.938279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:47.938705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:47.967255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f4cb890-58b4-449f-a9d1-0728f99db011 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043873 Sep 13 14:18:47.968356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 531/995] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:48.086592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:48.088712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:48.095233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:48.095736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:48.096164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:48.096847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:48.097375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:48.097826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:48.125886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7f54ffa8-5b5f-4ed7-8833-39af580c635e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043153 Sep 13 14:18:48.126423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 465/996] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:48.639390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:48.642364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:48.648517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:48.648999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:48.649434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:48.650165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:48.650617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:48.651037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:48.680147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f400b206-d99e-4106-a022-f91e52c3f98b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Sep 13 14:18:48.680687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 532/997] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:48.979564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:48.981685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:48.988253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:48.988719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:48.989138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:48.989842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:48.990287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:48.990701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:49.019599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1a77d97-cfe3-4fca-9c71-33590f2ee9cc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Sep 13 14:18:49.020144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 466/998] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:49.138612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:49.141606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:49.149061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:49.149481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:49.149945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:49.150645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:49.151100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:49.151518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:49.181408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c6e8a9d-81e2-4304-b149-d9991141a1c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046868 Sep 13 14:18:49.181998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 533/999] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:49.693380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:49.695534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:49.701573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:49.702080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:49.702506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:49.703227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:49.703674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:49.704088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:49.732058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2c7becc-b49b-4322-a405-3e14536611bb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042674 Sep 13 14:18:49.732602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 467/1000] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:50.032254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:50.034424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:50.040462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:50.040950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:50.041387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:50.042113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:50.042573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:50.043000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:50.072044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c6776c2-4045-4261-97c1-89e2c4364e65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Sep 13 14:18:50.072593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 534/1001] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:50.194265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:50.196461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:50.203208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:50.203685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:50.204111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:50.204801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:50.205249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:50.205664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:50.235688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32c2a3e3-aaf4-4f55-ba95-cd4adb70e8e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045907 Sep 13 14:18:50.236236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 468/1002] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:50.745122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:50.747305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:50.754117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:50.754597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:50.755023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:50.755701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:50.756147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:50.756566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:50.785544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0650915-7640-4057-8d5d-f6773fdc2010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Sep 13 14:18:50.786139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 535/1003] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:51.084131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:51.086198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:51.092159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:51.092656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:51.093084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:51.093783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:51.094234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:51.094654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:51.123299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b25f1579-bfb9-4541-80e2-3d64bfa8b71f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Sep 13 14:18:51.123926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 469/1004] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:51.247006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:51.249994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:51.255794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:51.256274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:51.256700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:51.257392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:51.257870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:51.258521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:51.292062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7f71833e-5fa4-42df-969a-0796724498c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048965 Sep 13 14:18:51.292612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 536/1005] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:51.798120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:51.800324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:51.806734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:51.807206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:51.807632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:51.808310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:51.808761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:51.809175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:51.837878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02b0f145-d99d-44c1-9d3e-f91aca644e7b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Sep 13 14:18:51.838427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 470/1006] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:52.136417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:52.138485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:52.145628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:52.146133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:52.146560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:52.147234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:52.147680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:52.148095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:52.176795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a85a793a-a912-41c0-834a-b745c09db29e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 Sep 13 14:18:52.177342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 537/1007] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:52.304403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:52.306720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:52.313225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:52.313709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:52.314191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:52.314889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:52.315461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:52.315884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:52.344953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4ac184f-f2e4-4fee-9184-3741aabf8ff4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044396 Sep 13 14:18:52.345511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 471/1008] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:52.850293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:52.852348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:52.859089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:52.859567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:52.859998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:52.860675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:52.861120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:52.861534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:52.889959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ca133c8-624d-4663-95c8-6deb411c689e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Sep 13 14:18:52.890499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 538/1009] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:53.189325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:53.191402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:53.197380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:53.197880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:53.198300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:53.198972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:53.199418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:53.199861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:53.216318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:53.230178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-556d9bda-3dff-4998-a87d-c11e9a527036 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Sep 13 14:18:53.230731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 472/1010] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:53.356678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:53.359251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:53.365352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:53.365874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:53.366303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:53.366983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:53.367431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:53.367847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:53.397268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-006493ea-82ea-4e09-a1f2-f5f2bde54a14 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044475 Sep 13 14:18:53.397826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 539/1011] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:53.905648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:53.907729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:53.913879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:53.914363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:53.914796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:53.915488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:53.915942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:53.916360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:53.945444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-646279ba-c99a-4640-8761-267fb9291fc3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Sep 13 14:18:53.946033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 473/1012] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:54.243653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:54.245840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:54.253238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:54.254448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:54.254448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:54.255856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:54.255856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:54.255856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:54.285082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fca613ed-ae5d-4304-8b17-eb2d3d73421b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Sep 13 14:18:54.285623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 540/1013] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:54.410097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:54.412228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:54.418530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:54.419010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:54.419438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:54.420325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:54.421413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:54.421875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:54.451523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53d8c7f4-ee50-4e0c-b4f2-56716783bfc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046090 Sep 13 14:18:54.452221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 474/1014] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:54.957614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:54.959811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:54.966175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:54.966654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:54.967085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:54.968597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:54.969053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:54.969477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:54.997599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82d585a5-0c20-4e54-953c-02bfa90b0145 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043885 Sep 13 14:18:54.998101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 541/1015] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:55.297070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:55.299176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:55.305079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:55.305556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:55.306012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:55.306696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:55.307143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:55.307559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:55.337945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-395268f0-0323-4eff-bb73-983d4e37f5df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Sep 13 14:18:55.338496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 475/1016] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:55.463644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:55.466534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:55.472499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:55.472985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:55.473415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:55.474147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:55.474602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:55.475023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:55.505199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18855b37-eece-4416-afe6-eddfa9b7214b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045722 Sep 13 14:18:55.505775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 542/1017] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:56.010449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:56.012494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:56.019907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:56.020387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:56.020806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:56.021497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:56.021979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:56.022399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:56.051648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae2e086b-1632-418c-bf26-fde60b5f1cf4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Sep 13 14:18:56.052212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 476/1018] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:56.350894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:56.352944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:56.359273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:56.359746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:56.360172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:56.360851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:56.361299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:56.361714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:56.390423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0b7321cd-556d-4941-a73a-5740aacf4caf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Sep 13 14:18:56.390957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 543/1019] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:56.520260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:56.527547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:56.534144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:56.534627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:56.535061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:56.535822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:56.536231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:56.536652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:56.566403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0901758e-67bd-4755-a04c-d4d67b5717fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052856 Sep 13 14:18:56.566965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 477/1020] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:57.064976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:57.067085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:57.072937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:57.073406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:57.073866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:57.074550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:57.074996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:57.075412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:57.103947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c740e00-4f3f-449f-8407-564f3a4c65e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Sep 13 14:18:57.104486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 544/1021] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:57.403191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:57.405774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:57.412101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:57.412571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:57.412999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:57.413677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:57.414152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:57.414568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:57.443381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-288c2e93-21b7-451b-8542-4a11d788da58 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Sep 13 14:18:57.443913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 478/1022] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:57.580199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:57.582733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:57.590007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:57.590497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:57.590933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:57.591640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:57.592095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:57.593009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:57.624886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c41a6ed6-cd71-4f1b-829f-d29ab7d871ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050294 Sep 13 14:18:57.625446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 545/1023] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:58.116871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:58.118972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:58.124990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:58.125463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:58.125924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:58.126607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:58.127053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:58.127471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:58.157171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79beb705-856b-4e44-a519-91d98410a686 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Sep 13 14:18:58.157744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 479/1024] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:58.455429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:58.457568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:58.463435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:58.463921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:58.464350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:58.465042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:58.465496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:58.465946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:58.469910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:18:58.497716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-31629221-140b-4bb7-aa3b-e9a533fc2e5f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Sep 13 14:18:58.498333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 546/1025] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:58.638397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:58.640628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:58.646754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:58.647234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:58.647667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:58.648356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:58.648804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:58.649227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:58.678803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3e1f37a-d835-49d2-84e5-de1e03b34212 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045173 Sep 13 14:18:58.679354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 480/1026] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:18:59.169792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:59.172044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:59.178419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:59.178894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:59.179322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:59.180007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:59.180460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:59.180880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:59.210256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cfa52abe-98aa-4b61-bc55-65b9a116434c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044588 Sep 13 14:18:59.210802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 547/1027] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:59.510563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:59.512683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:59.518894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:59.519367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:59.519793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:59.520480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:59.520928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:59.521344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:59.550961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b09c4b2-a746-4b77-a052-a148c1d3ecc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Sep 13 14:18:59.551518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 481/1028] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:18:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:18:59.692813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:18:59.694989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:18:59.701358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:59.702080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:59.702734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:59.703450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:18:59.703887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:18:59.704310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:18:59.734889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad2016c3-f558-44ab-802e-ee879719afb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047312 Sep 13 14:18:59.735440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 548/1029] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:18:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:00.223209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:00.225378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:00.231901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:00.232315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:00.232741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:00.233705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:00.234180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:00.234600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:00.264954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2591849c-7ac1-41b9-a950-2620f1d2781a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Sep 13 14:19:00.265500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 482/1030] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:00.563508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:00.565639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:00.572053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:00.572529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:00.572957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:00.573635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:00.574117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:00.574535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:00.604303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-687a131e-9445-4930-9e08-4938a21f764c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Sep 13 14:19:00.604862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 549/1031] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:00.747325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:00.750183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:00.755986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:00.756481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:00.756889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:00.757576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:00.758054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:00.758470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:00.788494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dc7d0688-091e-4b34-9111-d3a9136baedb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045104 Sep 13 14:19:00.789046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 483/1032] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:01.277695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:01.280549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:01.286448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:01.286921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:01.287349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:01.288026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:01.288472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:01.288886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:01.317593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3bf923f-ec06-48f9-bfd6-e5fa6cd36765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Sep 13 14:19:01.318094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 550/1033] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:01.617023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:01.619105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:01.625629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:01.626242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:01.626677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:01.627360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:01.627813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:01.628228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:01.658046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17728f25-07f5-4030-a363-5188072cc0cf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 13 14:19:01.658589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 484/1034] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:01.800885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:01.803122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:01.809346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:01.809854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:01.810285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:01.811054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:01.811661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:01.812081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:01.846544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9cb74732-dd2a-4af9-a0e5-6ed2288b8ade tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049692 Sep 13 14:19:01.847098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 551/1035] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:02.330123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:02.332312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:02.338230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:02.338711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:02.339144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:02.339836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:02.340291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:02.340716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:02.369794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd0f018c-b7ab-4662-ada2-e903721b7e01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 Sep 13 14:19:02.370287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 485/1036] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:02.671214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:02.673277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:02.679303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:02.679781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:02.680215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:02.680899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:02.681348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:02.681792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:02.710308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a58707fd-b7ce-4202-88ee-be96589a0e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Sep 13 14:19:02.710859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 552/1037] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:02.860973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:02.863164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:02.869172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:02.869648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:02.870111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:02.870810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:02.871262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:02.871683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:02.902130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bb5be39-4a01-46fe-9c6a-66c5e0cc1f91 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047120 Sep 13 14:19:02.902689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 486/1038] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:03.384013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:03.386206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:03.393541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:03.394057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:03.394492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:03.395183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:03.395638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:03.396060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:03.424983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b59d3d36-052e-4dca-8eee-93ac68304134 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Sep 13 14:19:03.425464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 553/1039] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:03.722901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:03.725040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:03.730981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:03.731482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:03.731911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:03.732596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:03.733049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:03.733568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:03.763084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cd9489f-26ba-4a58-a630-5d7eaa0c6bf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Sep 13 14:19:03.763627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 487/1040] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:19:03.915888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:03.918050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:03.920003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:03.933752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:03.934246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:03.934687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:03.935427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:03.935891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:03.936314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:03.968154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd19a8f9-3469-48b6-9fe5-697b438ebdfe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056756 Sep 13 14:19:03.968702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 554/1041] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:04.437331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:04.439435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:04.445829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:04.446311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:04.446775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:04.447459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:04.447911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:04.448329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:04.477508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-065568f9-5ca7-456c-bc14-d6b3f19061ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Sep 13 14:19:04.478089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 488/1042] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:04.776574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:04.778754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:04.785899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:04.786370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:04.786796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:04.787471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:04.787914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:04.788325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:04.816515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ac88fe27-794b-46dc-8207-9b1b6d979e61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Sep 13 14:19:04.817055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 555/1043] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:04.980282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:04.982469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:04.988365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:04.988854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:04.989288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:04.990010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:04.990495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:04.990918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:05.005252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:05.022370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfc4f982-8d4a-4237-b791-7be560b65980 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045971 Sep 13 14:19:05.022930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 489/1044] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:05.490116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:05.492262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:05.498127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:05.499271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:05.499784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:05.500475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:05.500923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:05.501342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:05.530339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7cd3ef4-b0e5-4858-8f53-933aacb5d174 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Sep 13 14:19:05.530897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 556/1045] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:05.828921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:05.831037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:05.837393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:05.837907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:05.838339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:05.839021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:05.839496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:05.839916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:05.868998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b302c8fe-6948-47f6-8dff-2f7e50e0fce4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Sep 13 14:19:05.869538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 490/1046] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:06.034733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:06.037240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:06.043574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:06.044052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:06.044486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:06.045370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:06.045994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:06.046427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:06.075855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-61dffc17-7047-4892-a58e-bd529cb58037 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045096 Sep 13 14:19:06.076905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 557/1047] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:06.543079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:06.546046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:06.552066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:06.552541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:06.552972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:06.553654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:06.554135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:06.554555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:06.582882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e607c7e3-6601-42e7-a543-ae5c75f14204 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043682 Sep 13 14:19:06.583364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 491/1048] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:06.882203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:06.884255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:06.890645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:06.891121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:06.891552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:06.892236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:06.892687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:06.893105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:06.922181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad2b450f-9bf4-4d58-9c66-012c2fdd5603 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Sep 13 14:19:06.922725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 558/1049] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:07.090239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:07.093098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:07.099262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:07.099770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:07.100198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:07.101067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:07.101320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:07.101768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:07.131342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f6003e5-a7fc-4aff-8fb5-573018311c40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046757 Sep 13 14:19:07.131896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 492/1050] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:07.596427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:07.598595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:07.604954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:07.605427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:07.605891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:07.606575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:07.607031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:07.607451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:07.637083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb92e548-61c4-457a-b5d2-4aab15d8488d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Sep 13 14:19:07.637630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 559/1051] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:07.934637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:07.937134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:07.943066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:07.943554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:07.943993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:07.944681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:07.945138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:07.945563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:07.986588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-121b86e1-7de0-4887-8de2-81551245c37d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055664 Sep 13 14:19:07.987178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 493/1052] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:08.144278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:08.146510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:08.152532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:08.153084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:08.153521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:08.154363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:08.155456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:08.155976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:08.185897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9d2143fe-3e66-4f5b-9021-3ffaf4d653ce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045941 Sep 13 14:19:08.186421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 560/1053] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:08.650200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:08.652341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:08.655280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:08.660717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:08.661192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:08.661622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:08.662326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:08.662770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:08.663186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:08.691815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c91221c-63b8-4e40-a97a-4bf8a16c883f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Sep 13 14:19:08.692355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 494/1054] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:08.999540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:09.001679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:09.008043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:09.008522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:09.008957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:09.009647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:09.010124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:09.010544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:09.039327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-55007d40-f00c-4afc-b695-ac781f7eb0eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Sep 13 14:19:09.039867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 561/1055] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:09.198280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:09.200694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:09.208611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:09.209175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:09.209617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:09.210410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:09.210863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:09.211292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:09.241547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70936b26-f1ac-43a6-9f94-6b72399284c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047184 Sep 13 14:19:09.242138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 495/1056] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:09.704472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:09.706678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:09.712614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:09.713092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:09.713523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:09.714245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:09.714728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:09.715148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:09.739704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:09.744731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7a7d2d1e-bf79-43d2-98b8-e99b9dc38270 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Sep 13 14:19:09.745283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 562/1057] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:10.051784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:10.053958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:10.060446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:10.060919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:10.061358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:10.062077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:10.062528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:10.062951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:10.093029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9434f2b-83be-4ca4-821b-5301a3121d95 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Sep 13 14:19:10.093574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 496/1058] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:10.254775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:10.256999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:10.263637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:10.264768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:10.265194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:10.267184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:10.267184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:10.267184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:10.295998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dac41097-5f2a-4792-bc9a-d7acdcf82c83 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045395 Sep 13 14:19:10.296549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 563/1059] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:10.756528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:10.758638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:10.764877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:10.765356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:10.765818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:10.766507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:10.766951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:10.767368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:10.796318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6db99088-6741-4c06-b33a-f235e39a7fac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Sep 13 14:19:10.796862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 497/1060] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:11.105922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:11.108183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:11.114110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:11.114581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:11.115008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:11.115686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:11.116130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:11.116544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:11.146204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eef07ba9-d507-4d04-b06c-8181662035d2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Sep 13 14:19:11.146735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 564/1061] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:11.308686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:11.312120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:11.318603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:11.319086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:11.319524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:11.320348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:11.320807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:11.321234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:11.350966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26fb1cd2-26bd-481c-bca4-b7f355560ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046510 Sep 13 14:19:11.351561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 498/1062] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:11.808792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:11.811100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:11.817455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:11.817966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:11.818399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:11.819080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:11.819533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:11.819956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:11.848720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bd83ac8d-fe47-4911-b971-5ca41d1d534e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043939 Sep 13 14:19:11.849289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 565/1063] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:12.158573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:12.160615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:12.167051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:12.167528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:12.167954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:12.168633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:12.169077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:12.169490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:12.199419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f50d8994-dcbd-471b-94ab-e6e06a5feb68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Sep 13 14:19:12.199971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 499/1064] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:12.363581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:12.365958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:12.372272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:12.372753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:12.373542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:12.374372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:12.374826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:12.375246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:12.405975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c90151e-f3f5-4c65-a6ae-a6541e756c13 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046271 Sep 13 14:19:12.406531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 566/1065] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:12.861108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:12.863282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:12.869699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:12.870220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:12.870659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:12.871349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:12.871809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:12.872236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:12.901382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83ed76ab-3b89-445a-a76f-c07e06ec554d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Sep 13 14:19:12.901963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 500/1066] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:13.212506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:13.214676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:13.221258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:13.221749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:13.222192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:13.222874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:13.223322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:13.223741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:13.253340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8369f33d-eac2-49a9-ade6-11ac4729e242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044795 Sep 13 14:19:13.253909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 567/1067] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:13.418392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:13.420522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:13.426397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:13.426871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:13.427298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:13.428118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:13.428580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:13.429039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:13.459618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90895dee-38cd-4b2a-8741-d0520a934187 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045107 Sep 13 14:19:13.460279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 501/1068] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:13.914282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:13.916427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:13.922298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:13.922774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:13.923201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:13.923877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:13.924334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:13.924765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:13.954109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3249469a-4dd4-4ae3-9a0a-65e06abc51af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043685 Sep 13 14:19:13.954638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 568/1069] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:14.266381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:14.268784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:14.275209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:14.275684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:14.276113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:14.276795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:14.277245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:14.277664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:14.306895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-220202e5-3eff-4cc2-a738-b64897bf9471 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Sep 13 14:19:14.307442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 502/1070] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:14.471708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:14.473875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:14.480261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:14.480734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:14.481171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:14.482004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:14.483042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:14.483466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:14.529678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3ebea7f-fdd3-4825-8930-af5bd765ce94 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058835 Sep 13 14:19:14.532106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 569/1071] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:14.966312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:14.969194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:14.975139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:14.975613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:14.976044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:14.976731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:14.977187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:14.977611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:15.006702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a89875ac-262a-41e5-a058-ee407b80772c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Sep 13 14:19:15.007246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 503/1072] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:15.319018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:15.321189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:15.327875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:15.328348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:15.328776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:15.329478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:15.329964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:15.330382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:15.359446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ec25728-c90b-4cbf-b2ae-2965c2db9d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Sep 13 14:19:15.359985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 570/1073] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:15.539810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:15.542075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:15.548740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:15.549199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:15.549628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:15.550346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:15.551055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:15.551483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:15.590484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0898841b-c567-4cb6-987e-f7a95ea3a15e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054734 Sep 13 14:19:15.591046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 504/1074] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:16.019368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:16.021541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:16.027607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:16.028088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:16.028933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:16.029200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:16.029650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:16.030109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:16.058838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7603cdc2-82df-44a4-b417-a0afa018c5cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Sep 13 14:19:16.059384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 571/1075] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:16.372031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:16.374295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:16.380227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:16.380704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:16.381135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:16.381914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:16.382367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:16.382789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:16.408336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:16.413510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-857d5969-962b-4cc1-b928-f536776be530 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Sep 13 14:19:16.414106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 505/1076] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:16.603802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:16.606432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:16.611823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:16.612498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:16.613279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:16.623580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:16.626135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:16.626750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:16.658080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-91f9bd70-96d9-47a0-b44f-ddf229858390 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058903 Sep 13 14:19:16.658772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 572/1077] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:17.071878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:17.074079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:17.080758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:17.081237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:17.081670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:17.082384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:17.082839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:17.083262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:17.112304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1657adcb-c31a-49e0-a0d5-7ba1bdaf1970 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Sep 13 14:19:17.112852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 506/1078] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:17.426430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:17.428575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:17.435008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:17.435618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:17.436192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:17.436901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:17.437358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:17.437812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:17.470068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-040ca28d-762b-4da7-9a34-2d217ff38d98 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Sep 13 14:19:17.470617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 573/1079] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:19:17.669773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:17.671913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:17.678084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:17.678575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:17.679017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:17.679725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:17.680183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:17.680617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:17.711932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db1138b1-da46-4c0c-95b2-3b68600aadc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046122 Sep 13 14:19:17.712516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 507/1080] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:18.125207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:18.127407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:18.133296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:18.133797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:18.134225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:18.134902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:18.135352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:18.135765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:18.164136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2738eac3-9410-4d99-aab2-bf16a10f61f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043490 Sep 13 14:19:18.164670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 574/1081] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:18.483940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:18.486113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:18.492553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:18.493034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:18.493462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:18.494186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:18.494643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:18.495064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:18.524033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eebfa236-c2a8-4536-97e9-466abba22f9b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Sep 13 14:19:18.524591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 508/1082] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:18.724305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:18.726485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:18.733422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:18.733855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:18.734285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:18.734971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:18.735420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:18.735898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:18.766027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7c329658-1d90-4e0e-bb76-28a504d5e4de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045581 Sep 13 14:19:18.766855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 575/1083] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:19.273671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:19.275923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:19.282367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:19.282786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:19.283238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:19.283909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:19.284360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:19.284777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:19.314035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-374b517d-a27e-4e24-9366-cdb35f756185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141048 Sep 13 14:19:19.314592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 509/1084] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:19.535553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:19.537670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:19.543538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:19.544012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:19.544439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:19.545766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:19.546229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:19.546642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:19.575587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f4d39c6-2b7e-4423-acad-144fe4f7ef0c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044006 Sep 13 14:19:19.576231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 576/1085] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:19.778388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:19.780587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:19.786637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:19.787055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:19.787481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:19.788164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:19.788610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:19.789033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:19.820050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d4087cd-8ab9-49a9-b1cb-ac979a284413 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045487 Sep 13 14:19:19.820613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 510/1086] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:20.328308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:20.330499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:20.336982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:20.337395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:20.337856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:20.338559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:20.339017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:20.339440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:20.369631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7eddb2af-4fad-4cc6-a2cf-c056d3510781 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Sep 13 14:19:20.370228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 577/1087] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:20.588076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:20.590189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:20.596209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:20.596681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:20.597108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:20.597813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:20.598259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:20.598673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:20.628995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-505c4309-31b0-4434-9d4c-44309ef2c3dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044885 Sep 13 14:19:20.629766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 511/1088] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:20.832680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:20.835375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:20.841280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:20.842215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:20.842796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:20.843486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:20.843932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:20.844349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:20.878265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eef3f5e9-ed3d-435a-8cd2-bb8855763bf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049509 Sep 13 14:19:20.879000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 578/1089] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:21.382083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:21.384254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:21.391196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:21.391669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:21.392095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:21.392770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:21.393486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:21.393944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:21.423250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e176950-a747-4b44-b5a3-cb9f72c006ff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 13 14:19:21.423724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 512/1090] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:21.641185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:21.643700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:21.650118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:21.650595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:21.651024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:21.651705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:21.652156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:21.652576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:21.668887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:21.682751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7f4d9d21-0467-4b84-b581-b4122791b0fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 Sep 13 14:19:21.683237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 579/1091] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:21.890974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:21.893395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:21.899338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:21.899817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:21.900248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:21.900941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:21.901387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:21.901829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:21.937897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c9e0e9b-7814-4e4e-b0e4-8ffaa49b94d6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051012 Sep 13 14:19:21.939182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 513/1092] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:22.436147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:22.438400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:22.444281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:22.444763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:22.445195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:22.445907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:22.446405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:22.446778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:22.475449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-330c87ed-7105-4052-8836-cb7df631ead8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Sep 13 14:19:22.475996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 580/1093] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:22.695634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:22.697829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:22.704839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:22.705314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:22.705767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:22.706457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:22.706907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:22.707329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:22.737093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ddf9290-be2a-45a2-8637-66aaafe5dd21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 13 14:19:22.737650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 514/1094] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:22.950978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:22.953843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:22.960172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:22.960651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:22.961082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:22.961787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:22.962236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:22.962654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:23.001314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21ff5592-bd60-4713-b1f8-e2ea20b071ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054170 Sep 13 14:19:23.001899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 581/1095] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:23.488446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:23.490612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:23.496733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:23.497211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:23.498287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:23.499071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:23.499531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:23.499961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:23.529150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96a3587d-a6ae-48e5-9fa6-25220f023aab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Sep 13 14:19:23.529912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 515/1096] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:23.748892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:23.751065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:23.757004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:23.757486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:23.757953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:23.758647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:23.759101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:23.759549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:23.789195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5622627b-4dc3-4c2a-bf86-3fc54ace70bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Sep 13 14:19:23.789766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 582/1097] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:24.014526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:24.016690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:24.022876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:24.023559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:24.023993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:24.024897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:24.025356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:24.025873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:24.060960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b49155b6-55b7-4c13-a876-2535e40b5757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051045 Sep 13 14:19:24.061917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 516/1098] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:24.542653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:24.544955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:24.551332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:24.551812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:24.552248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:24.552932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:24.553385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:24.553842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:24.582795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42b54bcf-4143-45c9-80db-6385aef5544d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Sep 13 14:19:24.583275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 583/1099] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:24.801692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:24.803902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:24.810944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:24.811416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:24.811846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:24.812527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:24.812977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:24.813394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:24.843209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89d78924-d458-4b66-b9a3-dede99123523 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045367 Sep 13 14:19:24.843688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 517/1100] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:25.072469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:25.074666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:25.081207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:25.081681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:25.082143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:25.082919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:25.083261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:25.083681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:25.113494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1f26f6c8-37a0-455d-908c-8a4edf69c064 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044976 Sep 13 14:19:25.114089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 584/1101] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:25.595152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:25.597266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:25.603227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:25.603697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:25.604124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:25.604806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:25.605249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:25.605665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:25.634707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6ce0ba9-d174-4ce6-aba3-506745c5c58a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 Sep 13 14:19:25.635181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 518/1102] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:25.855347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:25.858160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:25.864504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:25.864981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:25.865414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:25.866124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:25.866591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:25.866994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:25.896520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2178254e-433c-4198-bcef-7b102c8218cb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Sep 13 14:19:25.897001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 585/1103] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:26.126179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:26.128300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:26.134655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:26.135125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:26.135552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:26.136237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:26.136685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:26.137099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:26.167895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4948e477-0f88-49ae-8814-958688404831 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045904 Sep 13 14:19:26.168451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 519/1104] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:26.647773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:26.649932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:26.656497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:26.656971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:26.657395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:26.658107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:26.658551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:26.658966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:26.687192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8a7ffec-e8e2-4169-a7aa-4c2dcac26e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Sep 13 14:19:26.687667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 586/1105] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:26.908727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:26.910867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:26.916718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:26.917191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:26.917613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:26.918313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:26.918757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:26.919172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:26.949162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49dd878e-a4d1-4152-ad31-834ef5c87a73 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Sep 13 14:19:26.949706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 520/1106] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:27.180276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:27.182446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:27.189270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:27.189772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:27.190213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:27.190905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:27.191355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:27.191773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:27.221420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f78b6a6b-48c4-4965-88a1-c6a266079d03 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045008 Sep 13 14:19:27.222188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 587/1107] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:27.698890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:27.701281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:27.707644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:27.708113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:27.708537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:27.709216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:27.709661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:27.710102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:27.739460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85563d4a-d973-48d0-974d-7c8012fb7cce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Sep 13 14:19:27.739996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 521/1108] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:27.962707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:27.964984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:27.971521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:27.972038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:27.972468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:27.973150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:27.973635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:27.974077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:28.002451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-202ed9ae-3aa8-4ff3-ad78-2612dd8ff2c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Sep 13 14:19:28.003011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 588/1109] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:28.234604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:28.236787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:28.242853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:28.243328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:28.243755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:28.244472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:28.244921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:28.245337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:28.261666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:28.276388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c019a58-d5dc-4a2a-a7be-c1f3e47add59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046490 Sep 13 14:19:28.277074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 522/1110] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:28.751822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:28.753943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:28.760246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:28.760718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:28.761143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:28.761856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:28.762300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:28.762717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:28.792392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ead094f-cf99-44b9-b707-2bbc3ba4f9a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Sep 13 14:19:28.792933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 589/1111] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:29.015456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:29.017513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:29.024190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:29.024661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:29.025085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:29.025794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:29.026247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:29.026667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:29.056967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d963fb0-afcd-47bc-9d3f-45de8d3712dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046008 Sep 13 14:19:29.057509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 523/1112] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:29.288634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:29.291062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:29.297327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:29.297856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:29.298296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:29.298997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:29.299452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:29.299982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:29.329915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4df55268-1158-4bb7-b219-d2f12d38ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045310 Sep 13 14:19:29.330689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 590/1113] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:29.804459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:29.806614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:29.813087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:29.813562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:29.814018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:29.814707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:29.815161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:29.815584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:29.844907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c87a9d9b-ea88-42cf-98c2-9104e49674cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Sep 13 14:19:29.845458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 524/1114] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:30.069403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:30.071566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:30.078480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:30.078960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:30.079390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:30.080076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:30.080528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:30.080947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:30.109934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d20de7ac-9974-4714-ad94-1eed9f607171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Sep 13 14:19:30.110472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 591/1115] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:30.343068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:30.345573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:30.352056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:30.352541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:30.352971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:30.353666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:30.354148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:30.354567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:30.385099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ba9aced-c145-4123-8e13-26304ad61096 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046468 Sep 13 14:19:30.385664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 525/1116] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:30.856597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:30.859006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:30.864853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:30.865327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:30.865778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:30.866460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:30.866906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:30.867323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:30.896437 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-131ad43e-6a9e-4823-993a-36959649624f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Sep 13 14:19:30.896970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 592/1117] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:31.122427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:31.125417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:31.131447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:31.131915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:31.132338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:31.133017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:31.133490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:31.133939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:31.163787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-412f4e72-522c-44d7-af0f-629b24f8f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Sep 13 14:19:31.164322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 526/1118] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:19:31.396941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:31.399049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:31.405718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:31.406229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:31.406659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:31.407345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:31.407825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:31.408247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:31.439109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec431481-95e2-41e0-b5c7-140d49dd8740 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046502 Sep 13 14:19:31.439668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 593/1119] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:31.909313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:31.911478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:31.917961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:31.918439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:31.918876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:31.919566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:31.920645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:31.921067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:31.950219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1dd342cf-7c99-4705-bfcb-7b2573697e72 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044793 Sep 13 14:19:31.950762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 527/1120] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:32.176267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:32.178352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:32.184312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:32.184784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:32.185241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:32.185951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:32.186404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:32.186817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:32.215545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c2edad4b-f419-43d7-a2ce-10621ea7f31e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Sep 13 14:19:32.216093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 594/1121] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:32.452669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:32.454792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:32.461331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:32.461851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:32.462307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:32.462999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:32.463451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:32.463871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:32.494413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed975e81-cb6c-4fd9-9d1b-2744d4602acc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045732 Sep 13 14:19:32.494981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 528/1122] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:32.962513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:32.964677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:32.971587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:32.972062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:32.972495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:32.973180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:32.973629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:32.974107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:33.002763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-079329b0-beb7-42ca-a3e3-eaeb1183166d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Sep 13 14:19:33.003312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 595/1123] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:33.228193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:33.230407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:33.237356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:33.237828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:33.238279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:33.238959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:33.239404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:33.239818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:33.269293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9746d0e8-2314-4424-8234-3f791a7364e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Sep 13 14:19:33.269856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 529/1124] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:33.506620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:33.508696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:33.514593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:33.515070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:33.515804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:33.516511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:33.516964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:33.517385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:33.522089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:33.549099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dcc123b9-cfcb-47e8-8864-9f96175adccf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046369 Sep 13 14:19:33.549517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 596/1125] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:34.015896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:34.018342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:34.024291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:34.024775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:34.025209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:34.025938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:34.026395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:34.026818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:34.057071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f3b46cf-1b42-47bd-93f2-7fdcf6d9927f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Sep 13 14:19:34.057636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 530/1126] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:34.282044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:34.284179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:34.286898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:34.292061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:34.292541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:34.292976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:34.293664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:34.294141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:34.294563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:34.324128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08f71eff-ac65-49dc-b4ce-cd138b2d60dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046609 Sep 13 14:19:34.324672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 597/1127] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:34.561476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:34.564380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:34.570763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:34.571238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:34.571666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:34.572349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:34.572809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:34.573228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:34.602756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-972a7c56-800a-4279-a542-dd11eff83d5c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045256 Sep 13 14:19:34.603511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 531/1128] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:35.069117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:35.071343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:35.077293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:35.077816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:35.078253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:35.078935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:35.079388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:35.079809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:35.110398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7e914b69-a31d-4d8b-b897-4fa909d2cb9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Sep 13 14:19:35.111133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 598/1129] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:35.339782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:35.341971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:35.348722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:35.349209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:35.349639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:35.350358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:35.350809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:35.351235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:35.383575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b4d7ad2-50ac-482b-8c7e-f8a1cf58d2f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047813 Sep 13 14:19:35.384150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 532/1130] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:35.615673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:35.617786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:35.624714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:35.625426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:35.625884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:35.626681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:35.627177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:35.627869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:35.659683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f6f7c3d1-08a9-41f4-aa6b-0833da0f9cb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048021 Sep 13 14:19:35.660239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 599/1131] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:19:36.126314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:36.128443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:36.134807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:36.135282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:36.135706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:36.136384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:36.136829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:36.137246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:36.166735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4f93ad3-edad-45fe-a52e-093596a51e8e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Sep 13 14:19:36.167287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 533/1132] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:36.396480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:36.398674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:36.404563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:36.405034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:36.405976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:36.406659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:36.407100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:36.407513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:36.436603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc6f378b-885e-4c7e-b77f-0527f328b7a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Sep 13 14:19:36.437149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 600/1133] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:36.672393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:36.674490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:36.680425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:36.680900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:36.681332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:36.682064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:36.682517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:36.682940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:36.712636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79806a22-f084-4904-a144-264eb1984675 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044238 Sep 13 14:19:36.713197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 534/1134] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:37.179878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:37.182149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:37.188651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:37.189123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:37.189549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:37.190264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:37.190709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:37.191126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:37.219568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c34d1951-71f1-460f-a443-2d7bce0b8edf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Sep 13 14:19:37.220105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 601/1135] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:37.448997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:37.451159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:37.457533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:37.458068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:37.458507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:37.459196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:37.459647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:37.460067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:37.500109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-458aef8e-9ee0-4ff7-a025-bcc13d847fbc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054893 Sep 13 14:19:37.500683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 535/1136] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:37.725316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:37.727386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:37.733284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:37.734289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:37.734730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:37.735413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:37.735866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:37.736286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:37.765618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c32bc65-e6c1-4ec0-8466-ffe72931be3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Sep 13 14:19:37.766218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 602/1137] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:38.231745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:38.234411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:38.240362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:38.240832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:38.241281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:38.241989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:38.242437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:38.242852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:38.271770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32ff7d4e-6ca6-4926-b028-91993ef504c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Sep 13 14:19:38.272306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 536/1138] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:38.512385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:38.514554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:38.521214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:38.521687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:38.522532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:38.523230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:38.523708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:38.524124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:38.557303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dbcf2ac6-a5cb-4f16-a9fe-bf84ce651a88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048775 Sep 13 14:19:38.557878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 603/1139] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:38.778441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:38.781210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:38.783503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:38.788609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:38.789087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:38.789513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:38.790232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:38.790690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:38.791114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:38.821653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-baf37e19-ed8c-4f33-ad2b-6274112473ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047147 Sep 13 14:19:38.825088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 537/1140] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:39.284123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:39.286285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:39.292195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:39.292671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:39.293095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:39.293800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:39.294245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:39.294660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:39.324326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76aaefca-3854-4a1d-994c-b3a1902ae433 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044279 Sep 13 14:19:39.324865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 604/1141] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:39.570504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:39.572642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:39.578603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:39.579079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:39.579512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:39.580201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:39.580648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:39.581069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:39.610388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-384eb3e6-22c2-48d5-9ede-0b40b699554a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Sep 13 14:19:39.610934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 538/1142] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:39.834242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:39.836287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:39.842576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:39.843079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:39.843508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:39.844186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:39.844633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:39.845048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:39.873833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c49eb5d-1d64-4d4d-9dfe-685679e5d220 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043699 Sep 13 14:19:39.875041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 605/1143] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:40.336473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:40.338637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:40.345210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:40.345683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:40.346145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:40.346829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:40.347277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:40.347694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:40.351375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:40.378392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-249427f1-fc4d-43bd-a682-54e0dd93c45d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045675 Sep 13 14:19:40.378980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 539/1144] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:40.622750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:40.625526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:40.631714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:40.632213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:40.632647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:40.633344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:40.633828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:40.634254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:40.663901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-089a1050-a82e-4fc1-8907-9a2503803874 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 Sep 13 14:19:40.664462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 606/1145] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:40.887125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:40.889187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:40.896509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:40.896990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:40.897445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:40.898163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:40.898618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:40.899036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:40.927433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37182f80-613a-4d12-af21-8d1f81a84525 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Sep 13 14:19:40.927979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 540/1146] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:41.390926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:41.393303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:41.399660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:41.400118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:41.400542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:41.401215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:41.401661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:41.402103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:41.430602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb505f1a-f254-4cee-90dd-6fa03c789fd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Sep 13 14:19:41.431136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 607/1147] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:19:41.676823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:41.678992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:41.685290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:41.685789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:41.686221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:41.687099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:41.687640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:41.691774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:41.716684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ae1a847-ff2b-420a-9f2a-7a889582b2b1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Sep 13 14:19:41.717229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 541/1148] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:41.940390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:41.942615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:41.948523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:41.949002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:41.949436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:41.950158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:41.950609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:41.951029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:41.980487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19a4498e-94d1-4bfb-bee9-1aa4eec40508 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044668 Sep 13 14:19:41.981049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 608/1149] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:42.442873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:42.445034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:42.451120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:42.451597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:42.452019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:42.452784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:42.453168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:42.453585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:42.481994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6370116e-64b4-4895-9e25-872ed1d9c05f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Sep 13 14:19:42.482539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 542/1150] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:42.729562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:42.731726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:42.738787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:42.739266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:42.739697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:42.740383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:42.740833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:42.741252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:42.770448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b7f5916f-86d4-4fc7-b95e-08c02387d8e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Sep 13 14:19:42.771015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 609/1151] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:42.993578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:42.995669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:43.002144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:43.002617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:43.003047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:43.003726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:43.004170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:43.004585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:43.034511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87a043ef-61f7-41a4-8246-0f2714312e04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044942 Sep 13 14:19:43.035055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 543/1152] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:43.495055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:43.497189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:43.503785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:43.504265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:43.504693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:43.505373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:43.505966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:43.506670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:43.544039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65ebc2c8-9e2a-4727-be5d-f6da60014931 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052665 Sep 13 14:19:43.545056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 610/1153] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:43.785395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:43.787634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:43.793622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:43.794126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:43.794556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:43.795249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:43.795706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:43.796130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:43.825370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89825b56-0bbf-404b-8b61-f7c52c663bbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Sep 13 14:19:43.825962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 544/1154] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:44.047354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:44.049445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:44.055744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:44.056226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:44.056659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:44.057453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:44.057942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:44.058406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:44.088686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9eebd144-27e5-4d9a-9d51-51675b77fa77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045904 Sep 13 14:19:44.089261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 611/1155] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:44.557294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:44.559472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:44.566523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:44.567023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:44.567447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:44.568161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:44.568608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:44.569026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:44.597906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e786219d-e090-4762-9f1c-62dfdd4eb729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Sep 13 14:19:44.598442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 545/1156] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:44.839749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:44.841923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:44.847950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:44.848425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:44.848847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:44.849522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:44.849993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:44.850410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:44.874853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:44.880226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-746dcdf1-9a77-4c20-add9-491057a4615e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Sep 13 14:19:44.880970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 612/1157] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:19:45.101809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:45.103836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:45.110284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:45.110754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:45.111181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:45.111862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:45.112313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:45.112730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:45.144117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4f264e3-b651-4599-9baf-16c85438b59c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046306 Sep 13 14:19:45.144671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 546/1158] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:45.610734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:45.612853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:45.619223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:45.619692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:45.620117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:45.620791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:45.621235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:45.621652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:45.649692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-657ddf25-202c-4c01-b36c-3d39a83f6d6c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Sep 13 14:19:45.650245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 613/1159] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:45.892584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:45.894895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:45.901204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:45.901673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:45.902128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:45.902803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:45.903245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:45.903659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:45.932799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a983803-fb6a-4e52-b395-7844463354af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Sep 13 14:19:45.933328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 547/1160] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:46.157606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:46.159719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:46.165571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:46.166086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:46.166518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:46.167201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:46.167676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:46.168090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:46.196858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad0db7d3-1ead-4780-9c4e-003cd355336e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044169 Sep 13 14:19:46.197398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 614/1161] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:46.662424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:46.664567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:46.670635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:46.671112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:46.671561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:46.672236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:46.672686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:46.673111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:46.701287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24729631-c1f5-4efa-a8c8-4d5baecc7d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 Sep 13 14:19:46.701850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 548/1162] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:46.945828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:46.947946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:46.954657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:46.955140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:46.955575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:46.956263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:46.956714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:46.957137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:46.985478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a36062d-e9d4-49cd-935e-86fbe0a43df3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043668 Sep 13 14:19:46.986059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 615/1163] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:47.209446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:47.211663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:47.218184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:47.218655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:47.219079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:47.219757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:47.220198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:47.220611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:47.250453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-065cba14-8acb-4fd5-b03a-eebe736fe75f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044929 Sep 13 14:19:47.251010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 549/1164] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:47.714025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:47.716144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:47.722824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:47.723305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:47.723745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:47.724429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:47.724883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:47.725306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:47.760095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dd01886e-6f8a-4f8e-ad2f-cec65cb00c28 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049942 Sep 13 14:19:47.760651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 616/1165] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:47.998000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:48.000467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:48.006776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:48.007312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:48.007819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:48.008595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:48.009067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:48.009495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:48.040069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cca86a8-7ae7-4a8a-a0f4-59dcbf0deb81 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Sep 13 14:19:48.040626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 550/1166] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:48.262601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:48.265179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:48.271336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:48.271814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:48.272247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:48.272926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:48.273379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:48.273831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:48.302940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-726334e9-57db-4cc4-b39d-67408153e02d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Sep 13 14:19:48.303487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 617/1167] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:48.772827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:48.775058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:48.781681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:48.782135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:48.782565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:48.783254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:48.783711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:48.784134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:48.813827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43cbe249-647b-43ea-9d2c-af274470a50e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Sep 13 14:19:48.814384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 551/1168] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:49.052972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:49.055065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:49.062215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:49.062696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:49.063126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:49.063810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:49.064286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:49.064712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:49.093655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78de959c-7d92-4de3-8c97-c46e80ba1479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Sep 13 14:19:49.094225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 618/1169] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:49.315784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:49.317847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:49.323729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:49.324207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:49.324632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:49.325311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:49.325778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:49.326202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:49.354967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8acf4f24-606a-4f7d-9f89-1f37e73134b2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043251 Sep 13 14:19:49.355511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 552/1170] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:49.826181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:49.828478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:49.834465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:49.834944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:49.835377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:49.836057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:49.836511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:49.836933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:49.866079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e35ad33d-31ec-46a7-baaa-f5c0ed0f0e85 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Sep 13 14:19:49.866619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 619/1171] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:50.106117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:50.108936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:50.115398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:50.115892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:50.116329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:50.117012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:50.117460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:50.117908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:50.146510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9968bf52-202e-43b8-8875-b10f155fdc60 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Sep 13 14:19:50.147060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 553/1172] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:50.368246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:50.370445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:50.377217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:50.377700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:50.378161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:50.378860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:50.379310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:50.379731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:50.409692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f264c411-b771-4e1a-ac32-6307413408c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045568 Sep 13 14:19:50.410278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 620/1173] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:50.878790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:50.880994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:50.886970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:50.887447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:50.887882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:50.888574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:50.889025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:50.889776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:50.919056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-55b3cf55-cd54-42a0-8bc6-1361ef52edb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Sep 13 14:19:50.919607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 554/1174] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:51.159250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:51.161308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:51.167225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:51.167706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:51.168139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:51.168831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:51.169279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:51.169699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:51.199069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e245c1ef-c72d-4399-a830-96a022effc43 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Sep 13 14:19:51.199617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 621/1175] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:51.422852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:51.424922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:51.431220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:51.431689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:51.432118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:51.432790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:51.433234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:51.433651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:51.457745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:51.463099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-162ffce7-a090-472e-9c03-4cc03a40c8cb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044995 Sep 13 14:19:51.463644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 555/1176] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:51.932046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:51.934254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:51.940771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:51.941244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:51.941673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:51.942375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:51.942821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:51.943239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:51.972059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d308ce9-eb58-4824-a0e5-8b10d8fcea34 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Sep 13 14:19:51.972592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 622/1177] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:52.212043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:52.214232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:52.220107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:52.220572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:52.220997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:52.221674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:52.222151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:52.222570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:52.251784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08df7124-5c43-469c-ab07-5e615ec53014 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043892 Sep 13 14:19:52.252331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 556/1178] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:52.476223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:52.478335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:52.484730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:52.485210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:52.485640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:52.486351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:52.486805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:52.487226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:52.516831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6963fe7c-d04d-4131-a603-f87e27bc0f17 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044756 Sep 13 14:19:52.517389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 623/1179] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:52.984903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:52.987137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:52.993583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:52.994091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:52.994519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:52.995203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:52.995650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:52.996066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:53.024265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd185f03-1ac4-4c88-b007-bc0d7d529fbf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Sep 13 14:19:53.024801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 557/1180] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:53.264114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:53.266939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:53.273664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:53.274173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:53.274599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:53.275276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:53.275721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:53.276135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:53.304994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f32e895-035f-4e52-9ddf-0488e967f2f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Sep 13 14:19:53.305528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 624/1181] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:53.529856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:53.532426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:53.539481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:53.540322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:53.541177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:53.542457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:53.543290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:53.544059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:53.575876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e72dbf9-361b-4a66-a7e8-491d6beef553 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050102 Sep 13 14:19:53.576429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 558/1182] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:54.037679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:54.039835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:54.045953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:54.046458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:54.046890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:54.047622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:54.048072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:54.048491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:54.077130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37c0330a-854c-451e-bae7-5e041160e5c7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043317 Sep 13 14:19:54.078240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 625/1183] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:54.317449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:54.319634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:54.325517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:54.326022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:54.326450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:54.327126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:54.327569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:54.328650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:54.357402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-291267d9-5206-4936-94f0-fa8a93f46a36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Sep 13 14:19:54.357979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 559/1184] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:54.588092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:54.590172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:54.597003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:54.597476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:54.597935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:54.598612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:54.599056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:54.599473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:54.628295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eff241fb-4cf4-449f-be0c-97a889399bd2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044291 Sep 13 14:19:54.628828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 626/1185] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:19:55.090197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:55.092315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:55.098651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:55.099131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:55.099568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:55.100273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:55.100720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:55.101139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:55.130212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56bac04a-6747-4f40-a0d8-a546e0b3e787 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Sep 13 14:19:55.130956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 560/1186] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:55.369253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:55.371364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:55.377898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:55.378371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:55.378796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:55.379470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:55.379916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:55.380358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:55.409640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-90583f42-c974-4df1-b41a-7bd90dcfdf05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Sep 13 14:19:55.410210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 627/1187] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:55.640973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:55.643328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:55.649259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:55.649784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:55.650224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:55.650943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:55.651390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:55.651805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:55.681141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0abc7433-384c-4acf-8052-3bae42851d3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044326 Sep 13 14:19:55.681713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 561/1188] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:56.143857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:56.146033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:56.153306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:56.153855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:56.154297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:56.155000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:56.155454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:56.155964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:56.186329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ed34a57-7c02-4c96-bc8c-2bffdbc9003e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047420 Sep 13 14:19:56.187593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 628/1189] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:56.422870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:56.424934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:56.431265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:56.431732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:56.432154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:56.432835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:56.433284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:56.433699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:56.462902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bacb7567-1bbb-4b98-af1f-bb88a28c6d36 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Sep 13 14:19:56.463443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 562/1190] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:56.693875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:56.695949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:56.701791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:56.702266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:56.702718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:56.703502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:56.703951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:56.704370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:56.720866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:19:56.733893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5989d4f8-1328-4e22-b34a-43985439bf46 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044101 Sep 13 14:19:56.735066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 629/1191] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:57.199167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:57.201351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:57.207226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:57.207693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:57.208123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:57.208797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:57.209246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:57.209660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:57.238141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-410eadad-c586-4009-b269-94ce55f297a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Sep 13 14:19:57.238681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 563/1192] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:57.475448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:57.477578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:57.484648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:57.485130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:57.485563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:57.486276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:57.486729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:57.487150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:57.515711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-81a5f58d-a322-4d4f-8217-4f24ef6569f9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Sep 13 14:19:57.516257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 630/1193] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:57.747046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:57.749125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:57.755805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:57.756288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:57.756751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:57.757452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:57.757933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:57.758369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:57.787955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21edb3d7-f7dd-49bb-9f92-a676b6931d0f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044953 Sep 13 14:19:57.788514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 564/1194] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:58.250833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:58.252957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:58.258906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:58.259381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:58.259815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:58.260500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:58.260953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:58.261373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:58.290946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-687d0dcf-989d-4a87-be09-1a89912f6293 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Sep 13 14:19:58.291513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 631/1195] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:58.528412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:58.530847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:58.536801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:58.537273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:58.537702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:58.538418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:58.538867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:58.539312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:58.569253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8eed1dff-67d7-4291-954f-b54a182e7ba9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Sep 13 14:19:58.569820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 565/1196] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:58.800409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:58.802519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:58.808753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:58.809227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:58.809654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:58.810357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:58.810803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:58.811218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:58.840402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83edfaa1-b404-475a-b85e-c62ce5b030b4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044094 Sep 13 14:19:58.840939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 632/1197] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:19:59.303469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:59.305623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:59.312621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:59.313295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:59.313769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:59.314458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:59.314904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:59.315319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:59.344145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24601991-9a55-4601-bbcb-fc42c0196304 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Sep 13 14:19:59.344708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 566/1198] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:59.582414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:59.584533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:59.590402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:59.590877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:59.591300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:59.591970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:59.592411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:59.592823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:59.622519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d6b4dd3-8c1f-49d3-89b8-650e7c752fc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Sep 13 14:19:59.623063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 633/1199] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:19:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:19:59.852370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:19:59.854456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:19:59.860318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:59.860786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:59.861211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:59.861924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:19:59.862388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:19:59.862809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:19:59.891882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1369a4ad-ef1a-4a0d-a608-7c54d64b111a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043585 Sep 13 14:19:59.892417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 567/1200] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:19:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:00.356425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:00.358706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:00.365691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:00.366221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:00.366657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:00.367347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:00.367802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:00.368227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:00.396623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65eb92d0-40c6-40b6-a37b-ca536b544b32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044102 Sep 13 14:20:00.397175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 634/1201] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:00.635627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:00.637910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:00.644709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:00.645185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:00.645619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:00.646336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:00.646787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:00.647211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:00.677158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15ef857f-8ac4-4514-aed5-c9e2d9b9283b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 Sep 13 14:20:00.677708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 568/1202] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:00.904680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:00.906819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:00.912667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:00.913135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:00.913558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:00.914265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:00.914708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:00.915121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:00.944046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bc64d0ad-b238-4b24-a74c-659eaad25bca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043469 Sep 13 14:20:00.944582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 635/1203] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:01.408883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:01.411023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:01.417042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:01.417519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:01.417970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:01.418651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:01.419094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:01.419507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:01.448066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a99e78ce-239f-49b9-a9ee-c0154d274929 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043610 Sep 13 14:20:01.448613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 569/1204] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:01.690432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:01.692569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:01.698887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:01.699362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:01.699791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:01.700474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:01.700920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:01.701342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:01.729604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6a7a7ac8-1a2a-42e9-a71f-5f075b92a052 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Sep 13 14:20:01.730176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 636/1205] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:01.957362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:01.959517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:01.965903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:01.966380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:01.966809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:01.967497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:01.967946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:01.968435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:01.996840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cce840cd-8964-470f-9826-ea6e4f2c92bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044343 Sep 13 14:20:01.997389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 570/1206] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:02.460329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:02.462493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:02.469043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:02.469630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:02.470100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:02.470793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:02.471244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:02.471668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:02.500349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97524af6-e0ef-4a5e-b424-44dfb183856c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Sep 13 14:20:02.501176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 637/1207] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:02.742578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:02.744731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:02.751211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:02.751690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:02.752220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:02.752915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:02.753367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:02.753814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:02.785415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57928ce1-9745-44b3-9122-c8cf0e4957f5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Sep 13 14:20:02.786047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 571/1208] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:03.009783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:03.011868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:03.019168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:03.019649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:03.020078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:03.020764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:03.021213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:03.021628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:03.051645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8403ff1-a13b-44e5-9e2f-ecb61a070ec1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045887 Sep 13 14:20:03.052184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 638/1209] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:03.512133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:03.514306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:03.521678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:03.522584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:03.523015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:03.523741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:03.524188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:03.524607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:03.541238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:03.554473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-998ad58f-03a2-4843-8516-03a3ebdb64f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046331 Sep 13 14:20:03.555024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 572/1210] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:03.798638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:03.800685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:03.806700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:03.807177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:03.807606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:03.808288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:03.808737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:03.809157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:03.838575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9f7f8989-afc5-439a-b52d-c024fc2883ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Sep 13 14:20:03.839122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 639/1211] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:04.065182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:04.067266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:04.073147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:04.073622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:04.074083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:04.074769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:04.075218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:04.075635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:04.106854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cc1cf13-2160-4d2e-8884-1df620b4734a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046440 Sep 13 14:20:04.107421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 573/1212] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:04.567677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:04.569982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:04.572207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:04.577335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:04.577887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:04.578326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:04.579015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:04.579465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:04.579884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:04.609374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78b86b2a-3571-4524-b3ab-3435535d314b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Sep 13 14:20:04.610054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 640/1213] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:04.850847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:04.852966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:04.859947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:04.860412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:04.860834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:04.861508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:04.861972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:04.862387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:04.890686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38d204f2-0d0d-4b74-a568-dbad5865d3a1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 Sep 13 14:20:04.891229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 574/1214] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:05.119356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:05.121422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:05.132568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:05.132568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:05.132568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:05.132568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:05.133029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:05.133029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:05.161141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-64356896-e48e-4bd1-bf7c-68c3ab6ccf77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045810 Sep 13 14:20:05.161684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 641/1215] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:05.622037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:05.624164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:05.630979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:05.631479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:05.631912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:05.632647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:05.633098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:05.633514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:05.662949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bceb2fc-b490-4646-b113-786e1c856b5e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Sep 13 14:20:05.663501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 575/1216] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:05.903523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:05.906181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:05.912608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:05.913089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:05.913524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:05.914237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:05.914690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:05.915113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:05.944249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ef2d51e-ebfc-4d29-abc2-2ec25d4aea8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 Sep 13 14:20:05.944789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 642/1217] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:06.174321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:06.176366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:06.182717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:06.183183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:06.183609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:06.184288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:06.184733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:06.185151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:06.214734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-216052e1-6ca4-4923-b501-6f83a269b22b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044651 Sep 13 14:20:06.215277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 576/1218] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:06.675757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:06.677963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:06.684188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:06.684665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:06.685097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:06.685804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:06.686417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:06.687447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:06.716817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c631aae-f4bc-413d-80ba-ac607bb3a1fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Sep 13 14:20:06.717356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 643/1219] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:06.957455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:06.959591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:06.965442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:06.965948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:06.966374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:06.967055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:06.967499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:06.968542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:06.996799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8051a6d-8aa3-4d95-bf68-27af712211bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Sep 13 14:20:06.997345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 577/1220] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:07.227906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:07.230019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:07.236352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:07.236828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:07.237259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:07.237972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:07.238427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:07.238848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:07.268895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89e577f0-1c66-4be4-815d-3cbacf79262f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045044 Sep 13 14:20:07.269445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 644/1221] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:07.728268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:07.730487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:07.737601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:07.738139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:07.738575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:07.739295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:07.739747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:07.740351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:07.771380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6b07563-75db-4b37-b3a7-23fec1c9dbba tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 Sep 13 14:20:07.771936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 578/1222] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:08.009130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:08.011293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:08.018040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:08.018518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:08.018946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:08.019626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:08.020072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:08.020488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:08.050036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8a794323-3989-4392-80c6-0d6289ecb4a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Sep 13 14:20:08.050577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 645/1223] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:08.281242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:08.283373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:08.289207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:08.289670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:08.290120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:08.290797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:08.291240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:08.291651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:08.320066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98e90ad6-658c-4020-9af8-53e60211611e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043519 Sep 13 14:20:08.320617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 579/1224] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:08.784301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:08.786531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:08.793038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:08.793510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:08.793976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:08.794727 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:08.795180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:08.795597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:08.799902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:08.825693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d1f1bb9-b578-46a8-830d-081a67c2da9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Sep 13 14:20:08.826297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 646/1225] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:09.062481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:09.064557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:09.066847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:09.071895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:09.072370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:09.072795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:09.073472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:09.073945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:09.074366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:09.104205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82d21ba5-05e8-4130-acf5-a0fb84dd2c72 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Sep 13 14:20:09.104830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 580/1226] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:09.333328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:09.335436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:09.341320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:09.341833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:09.342268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:09.342952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:09.343413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:09.343824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:09.372803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f6355984-db98-4ebf-bdc9-c1bb9ff57ea1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043586 Sep 13 14:20:09.373358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 647/1227] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:09.838037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:09.840199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:09.846939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:09.847413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:09.847845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:09.848541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:09.848989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:09.849408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:09.879711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-197f6a16-566a-406f-bde7-834154d7b212 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Sep 13 14:20:09.880260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 581/1228] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:10.116881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:10.119004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:10.125936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:10.126418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:10.126849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:10.127524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:10.127970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:10.128385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:10.157500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0318d354-e22d-44af-988d-11735aa4a65e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Sep 13 14:20:10.158071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 648/1229] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:10.385954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:10.387988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:10.395352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:10.395825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:10.396285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:10.396962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:10.397410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:10.397852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:10.426664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f7d21d9-c781-4717-8d88-f2b5ef5ff218 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044848 Sep 13 14:20:10.427205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 582/1230] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:10.892127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:10.894591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:10.900796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:10.901277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:10.901710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:10.902414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:10.902963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:10.903414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:10.941623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7b97d9e-8592-45ad-aaaa-14c0e3fdc7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053372 Sep 13 14:20:10.942202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 649/1231] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:11.170133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:11.172413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:11.178324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:11.178794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:11.179219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:11.179900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:11.180343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:11.180761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:11.210934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51b4466d-6538-4f09-b5da-ba80908da7c0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044912 Sep 13 14:20:11.211484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 583/1232] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:11.439425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:11.441554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:11.448027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:11.448509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:11.448942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:11.449618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:11.450090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:11.450508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:11.479315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dcc031a2-24e0-4a04-b055-dee8ad0f3c84 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044544 Sep 13 14:20:11.479861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 650/1233] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:11.954222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:11.956385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:11.962880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:11.963437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:11.963778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:11.964469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:11.964920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:11.965339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:11.995972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94fa19ca-d803-4bf5-8bd6-790baebc4889 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046371 Sep 13 14:20:11.996525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 584/1234] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:12.223534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:12.225678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:12.231649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:12.232135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:12.232568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:12.233763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:12.234449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:12.234976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:12.264695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3a035148-42a0-4056-b94c-b598c666a68b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Sep 13 14:20:12.265546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 651/1235] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:12.492017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:12.494158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:12.500263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:12.500743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:12.501175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:12.501892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:12.502345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:12.502770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:12.533168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5d9edf4-3444-43dc-9b8c-b796350ad4b1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045140 Sep 13 14:20:12.533752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 585/1236] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:13.008304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:13.010527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:13.017434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:13.018209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:13.018640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:13.019330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:13.019786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:13.020183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:13.050521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c273477-c114-4c21-bc4e-0a3894775fa1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Sep 13 14:20:13.051066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 652/1237] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:13.277470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:13.279532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:13.286244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:13.286712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:13.287139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:13.287815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:13.288263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:13.288676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:13.317866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82074b5f-ffee-4c7d-936e-a84beced65e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Sep 13 14:20:13.318412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 586/1238] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:13.545663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:13.548404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:13.554258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:13.554732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:13.555160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:13.555840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:13.556290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:13.556741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:13.586169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ad9cbd9-e232-492d-8e3f-11e395b22e98 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044378 Sep 13 14:20:13.586713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 653/1239] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:14.063093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:14.065141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:14.071267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:14.071738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:14.072166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:14.072849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:14.073300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:14.073712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:14.105281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-312b6a8a-3ff9-464a-b350-834278119365 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 Sep 13 14:20:14.106168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 587/1240] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:14.330475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:14.332583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:14.338964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:14.339440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:14.339867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:14.340545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:14.340990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:14.341409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:14.370960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-25add6f4-5cbe-487a-93ed-88f1245da2fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045263 Sep 13 14:20:14.371501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 654/1241] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:14.598761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:14.600840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:14.607194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:14.607672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:14.608105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:14.608866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:14.609319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:14.609749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:14.638480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-adf3528f-2511-4ed8-8a67-68b4e358d45d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043876 Sep 13 14:20:14.639028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 588/1242] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:15.118636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:15.120776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:15.127659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:15.128306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:15.128744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:15.129444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:15.129931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:15.130359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:15.161620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ffd18f42-bc71-4b5d-89bb-d75cd7141d51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Sep 13 14:20:15.166394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 655/1243] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:15.383059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:15.385138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:15.391238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:15.391713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:15.392140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:15.393084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:15.393529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:15.393972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:15.397561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:15.424187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f28eafe-16e9-4211-ab74-3c17129c0cb8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Sep 13 14:20:15.424735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 589/1244] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:15.651246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:15.653288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:15.660264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:15.660736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:15.661161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:15.661866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:15.662315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:15.662730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:15.692825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a2769490-0f5b-4c01-9dff-c56da96258ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045676 Sep 13 14:20:15.698601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 656/1245] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:16.174645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:16.176821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:16.182898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:16.183370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:16.183797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:16.184479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:16.184954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:16.185370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:16.214172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec9fbb67-6c99-4dfc-bece-05cf524e62cd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Sep 13 14:20:16.214868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 590/1246] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:16.436940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:16.439019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:16.444945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:16.445417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:16.445879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:16.446561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:16.447005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:16.447423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:16.477696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bea73981-0562-4b3d-83f5-2e8d9579b80d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Sep 13 14:20:16.477997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 657/1247] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:16.705705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:16.707849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:16.713848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:16.714325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:16.714757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:16.715444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:16.715895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:16.716315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:16.745061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-968a1480-2572-4c57-b552-010e64f0cbe9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044144 Sep 13 14:20:16.745610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 591/1248] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:17.226277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:17.228340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:17.235098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:17.235576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:17.236003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:17.237083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:17.237186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:17.237525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:17.267071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d2345b89-01e1-4334-8a8a-db2ab45be94a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Sep 13 14:20:17.272140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 658/1249] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:17.490357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:17.492439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:17.499013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:17.499489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:17.500657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:17.501446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:17.501934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:17.502359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:17.532158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e471d542-e004-4788-9783-cdafd2efa7f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 13 14:20:17.532728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 592/1250] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:20:17.757788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:17.759830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:17.766279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:17.766755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:17.767190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:17.768130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:17.768584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:17.768999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:17.798565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd41ec4d-f7aa-45d9-94c8-bef26a027c80 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044880 Sep 13 14:20:17.799105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 659/1251] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:18.279766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:18.282471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:18.288584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:18.289057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:18.289486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:18.290206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:18.290656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:18.291081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:18.325073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44303e40-cd68-4ad1-b425-1e290244dcff tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049362 Sep 13 14:20:18.325891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 593/1252] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:18.544762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:18.546903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:18.552848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:18.553329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:18.553859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:18.554548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:18.554998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:18.555418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:18.585014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c3814c76-49ef-4cd1-a706-fc98ffcc0436 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Sep 13 14:20:18.585565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 660/1253] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:18.811087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:18.813803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:18.820141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:18.820612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:18.821037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:18.821719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:18.822207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:18.822624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:18.850750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3cd83fad-0aa0-4a99-a7ee-6c34eba04fb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043764 Sep 13 14:20:18.851287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 594/1254] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:19.338628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:19.340674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:19.347975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:19.348415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:19.348881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:19.349660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:19.350174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:19.350601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:19.382018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ebd4803-b65a-4f46-816e-403aa9664b27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Sep 13 14:20:19.382582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 661/1255] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:19.597557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:19.599719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:19.605800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:19.606384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:19.606832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:19.607606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:19.608057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:19.608497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:19.638652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ff39fd7-d550-4e59-935b-9084d0757270 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Sep 13 14:20:19.639216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 595/1256] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:19.863119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:19.865203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:19.871260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:19.871744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:19.872177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:19.872861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:19.873310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:19.873758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:19.898957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:19.904247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d00ed77f-7345-419a-881c-af3641f4ade6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045152 Sep 13 14:20:19.904792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 662/1257] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:20.394841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:20.396940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:20.403930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:20.404409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:20.404839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:20.405568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:20.406077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:20.406391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:20.435730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3b86716-b507-4dfa-96ac-af55c03fddda tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045242 Sep 13 14:20:20.436289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 596/1258] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:20.651864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:20.653975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:20.661089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:20.661568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:20.662042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:20.662731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:20.663189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:20.663611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:20.692876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f9070691-39d9-4e4b-8d1e-58961d9af997 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Sep 13 14:20:20.693416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 663/1259] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:20.916993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:20.919049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:20.925629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:20.926133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:20.926568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:20.927252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:20.927701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:20.928122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:20.957097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b25b072e-8209-4ef3-8cde-55a428ed25fe tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044201 Sep 13 14:20:20.957653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 597/1260] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:20:21.448527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:21.450670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:21.457177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:21.457649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:21.458207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:21.458893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:21.459339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:21.459755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:21.489362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2f7cee77-d7be-4c3c-8c8c-455089812ac4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Sep 13 14:20:21.489952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 664/1261] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:21.704986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:21.707057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:21.713470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:21.713980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:21.714412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:21.715101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:21.715545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:21.715961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:21.744839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c17cbee2-8591-45e0-9e9c-c24f3fa68346 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Sep 13 14:20:21.745382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 598/1262] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:21.969535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:21.971585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:21.977870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:21.978350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:21.978782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:21.979461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:21.979911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:21.980331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:22.010055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e89c4e3-e31b-4382-ae98-0e900c6816bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044632 Sep 13 14:20:22.010594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 665/1263] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:22.501085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:22.504140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:22.510674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:22.511159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:22.511582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:22.512463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:22.512912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:22.513329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:22.544172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b8ffc2a-6cfc-493c-9ec4-7b86d3d251b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047235 Sep 13 14:20:22.544734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 599/1264] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:22.757640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:22.759789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:22.765696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:22.766209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:22.766683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:22.767450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:22.768157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:22.768579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:22.797391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d05ee9f2-726a-4529-a2f1-86e7de83bcfd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Sep 13 14:20:22.798631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 666/1265] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:23.024500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:23.026793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:23.034018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:23.034500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:23.034932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:23.035622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:23.036073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:23.036494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:23.066323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b895a1b8-57dd-497d-a9b6-251db830227a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045702 Sep 13 14:20:23.066866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 600/1266] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:23.556525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:23.558694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:23.565721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:23.566230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:23.566664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:23.567351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:23.567803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:23.568224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:23.598505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-39ef67c6-115a-420b-881e-9d489dda63d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 Sep 13 14:20:23.599062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 667/1267] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:23.810131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:23.812163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:23.818835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:23.819309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:23.819737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:23.820412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:23.820856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:23.821270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:23.850054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75957460-7cab-4f5b-ab98-a8b006f110a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 Sep 13 14:20:23.850601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 601/1268] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:24.078616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:24.081535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:24.087447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:24.087933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:24.088367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:24.089054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:24.089539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:24.089988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:24.120371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-966238e2-88c1-44f9-8e66-c30cbd2d029b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045793 Sep 13 14:20:24.120929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 668/1269] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:24.611060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:24.613881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:24.619949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:24.620423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:24.620851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:24.621534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:24.622009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:24.622431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:24.652632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43e15d84-e7ab-40d1-b65d-94cd3705086a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Sep 13 14:20:24.653180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 602/1270] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:24.862636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:24.865002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:24.871715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:24.872190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:24.872618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:24.873303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:24.873770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:24.874188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:24.903686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5fb5dc77-cad1-41d3-9881-3bc3dbd1ab9d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Sep 13 14:20:24.904238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 669/1271] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:25.133352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:25.136122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:25.144378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:25.145079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:25.145637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:25.146394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:25.146854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:25.147281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:25.177996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd95eeaf-1760-438e-82c5-875355e48ffb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048686 Sep 13 14:20:25.178565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 603/1272] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:25.665071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:25.667191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:25.672999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:25.673473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:25.674451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:25.675130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:25.675578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:25.675999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:25.706714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fc64494c-8641-4c7f-877e-5ebb73265bd7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Sep 13 14:20:25.707304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 670/1273] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:25.916552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:25.918672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:25.925240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:25.925713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:25.926169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:25.926853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:25.927299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:25.927725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:25.956277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6e3bc78-6eba-4a2b-97e0-085eab7a643d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Sep 13 14:20:25.956823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 604/1274] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:26.190801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:26.192921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:26.199267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:26.199742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:26.200176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:26.200867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:26.201319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:26.201765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:26.231458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aad13c0c-5f67-4aee-86ea-bad3cef78490 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044773 Sep 13 14:20:26.232011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 671/1275] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:26.719302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:26.721820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:26.728223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:26.728694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:26.729118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:26.729832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:26.730277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:26.730692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:26.755034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:26.760529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3690507f-c6ae-430c-9383-675cacfdbf80 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045183 Sep 13 14:20:26.761183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 605/1276] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:26.968457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:26.970645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:26.976871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:26.977345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:26.977790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:26.978469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:26.978926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:26.979334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:27.009100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a251621-5a36-42ff-ae59-85b46a83f099 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Sep 13 14:20:27.009643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 672/1277] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:27.244114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:27.246286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:27.252163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:27.252729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:27.253159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:27.253876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:27.254329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:27.254749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:27.283990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d41a6444-b60f-4aab-9673-d2fc2889352e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043567 Sep 13 14:20:27.284504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 606/1278] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:27.773999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:27.776030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:27.782844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:27.784020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:27.784464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:27.785153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:27.785606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:27.786056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:27.814023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-897e1517-6a2f-4238-ae90-d451a424ddd2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Sep 13 14:20:27.814641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 673/1279] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:20:28.021591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:28.023941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:28.030658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:28.031073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:28.031502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:28.032193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:28.032642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:28.033063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:28.063327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d0ebeff-4db3-45f9-8986-cca3d3150f6b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Sep 13 14:20:28.063906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 607/1280] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:28.296724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:28.298785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:28.304899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:28.305372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:28.305854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:28.306534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:28.306997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:28.307452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:28.337339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd5184a3-ccdb-4c01-ba48-f2a4767a7504 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044814 Sep 13 14:20:28.337944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 674/1281] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:28.827422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:28.829589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:28.836758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:28.837252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:28.837704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:28.838447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:28.838965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:28.839457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:28.869289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39621ffe-f220-4b0f-b80c-399fe9aa627d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Sep 13 14:20:28.869862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 608/1282] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:20:29.076686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:29.078956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:29.086311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:29.086796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:29.087233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:29.087926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:29.088386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:29.088810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:29.118406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7fb4bc5-3407-451b-8388-cd72c773f178 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Sep 13 14:20:29.118961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 675/1283] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:29.350053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:29.352171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:29.358611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:29.359068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:29.359498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:29.360220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:29.360675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:29.361096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:29.391812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dfecabe7-0ba3-40d9-8e62-c7c5736c99b9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045958 Sep 13 14:20:29.392367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 609/1284] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:29.882236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:29.884268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:29.890401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:29.890898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:29.891327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:29.892254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:29.893093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:29.893516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:29.923171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3365f3b-9635-4bd9-ab8b-e9a6ba027662 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Sep 13 14:20:29.923708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 676/1285] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:30.132633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:30.134784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:30.140757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:30.141235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:30.141669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:30.142375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:30.143126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:30.143549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:30.172625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-965b749b-6845-4332-9f2b-34afefb2647a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Sep 13 14:20:30.173179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 610/1286] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:30.403927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:30.406002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:30.412843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:30.413351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:30.413811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:30.414528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:30.414978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:30.415402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:30.444435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cec23957-7bc2-4d09-a70d-e6d118e7efca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044533 Sep 13 14:20:30.444978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 677/1287] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:30.936265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:30.938374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:30.945441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:30.945960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:30.946396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:30.947082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:30.947532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:30.947951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:30.976993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4857a102-0936-4e16-a98e-00d61b8b60c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Sep 13 14:20:30.977546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 611/1288] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:31.186534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:31.188589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:31.194579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:31.195060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:31.195560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:31.196184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:31.196633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:31.197054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:31.226562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58b695ea-e8cc-41c1-ae2a-f1ea34286aaf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Sep 13 14:20:31.227109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 678/1289] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:31.457478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:31.459655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:31.465687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:31.466194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:31.466624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:31.467307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:31.467758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:31.468183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:31.497660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c1139ef-fe9b-4643-b3b1-584d609b0d54 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044697 Sep 13 14:20:31.498253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 612/1290] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:31.990130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:31.992346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:31.998690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:31.999159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:31.999586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:32.000259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:32.000704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:32.001147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:32.018151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:32.031514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5a594f49-fabd-4ac1-a6f4-3c3e8cc6e4be tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046465 Sep 13 14:20:32.032059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 679/1291] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:32.239005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:32.241179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:32.247728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:32.248198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:32.248622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:32.249297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:32.249826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:32.250251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:32.280462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5321a808-9ba1-4082-aaaf-537732606a6f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Sep 13 14:20:32.281075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 613/1292] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:32.510550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:32.512894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:32.520265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:32.520774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:32.521204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:32.521940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:32.522402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:32.522827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:32.555261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05902482-bcb0-4fec-922a-0ef2d2f38a77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048728 Sep 13 14:20:32.555807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 680/1293] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:33.044358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:33.046459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:33.053120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:33.053595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:33.054058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:33.054746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:33.055196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:33.055618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:33.084714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f9663032-1507-4391-b124-0f35d0fa8be3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Sep 13 14:20:33.085271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 614/1294] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:33.294084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:33.297292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:33.307176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:33.307832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:33.308367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:33.309475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:33.310218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:33.310764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:33.342883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f4d98b09-233e-49c2-850f-ded23df3b8cd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052738 Sep 13 14:20:33.343543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 681/1295] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:33.567579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:33.569665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:33.576194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:33.576685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:33.577114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:33.577906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:33.578355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:33.578770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:33.608698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4fc74b6-efa8-4fb3-842d-f629b9c9d6de tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045786 Sep 13 14:20:33.609284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 615/1296] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:34.096612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:34.099474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:34.105306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:34.105838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:34.106274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:34.106954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:34.107400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:34.107817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:34.139300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fce1aa0e-9f8c-418c-bebd-e0d800096acc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Sep 13 14:20:34.139857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 682/1297] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:34.356048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:34.358149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:34.364238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:34.364711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:34.365139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:34.365922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:34.366411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:34.366800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:34.399635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afeb8b1d-a887-4131-9e03-c4ebda76dcb9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 Sep 13 14:20:34.400577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 616/1298] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:34.622298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:34.624435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:34.626758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:34.632264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:34.632743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:34.633209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:34.634114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:34.634737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:34.635163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:34.666524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72c57e1c-ecf3-4c8b-9232-ae6c9954e988 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048537 Sep 13 14:20:34.667069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 683/1299] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:35.152273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:35.154542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:35.161964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:35.162447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:35.162980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:35.163587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:35.164039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:35.164471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:35.193425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02ec7ab4-81ef-4530-8e30-b5b1ae52c007 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Sep 13 14:20:35.194035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 617/1300] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:35.413695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:35.416387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:35.423007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:35.423479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:35.423907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:35.424583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:35.425162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:35.425582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:35.456759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f05abc65-2921-49ff-8dd8-fcc37259d619 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047844 Sep 13 14:20:35.457489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 684/1301] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:35.678543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:35.680576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:35.686505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:35.686974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:35.687401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:35.688080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:35.688528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:35.688939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:35.719283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea69b8f2-0c92-4559-8727-0dae06d673a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Sep 13 14:20:35.719845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 618/1302] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:36.206769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:36.210456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:36.217660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:36.218304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:36.219107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:36.219806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:36.220256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:36.220674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:36.255651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3dfbed72-b023-4a85-8156-5b6ab9484082 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053119 Sep 13 14:20:36.256218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 685/1303] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:36.470342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:36.472887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:36.480307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:36.481054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:36.481646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:36.482291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:36.482740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:36.483159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:36.515215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cbcfc754-1518-47b8-863e-14ff402cc4b4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048805 Sep 13 14:20:36.515777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 619/1304] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:20:36.732427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:36.734550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:36.741750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:36.742246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:36.742678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:36.743380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:36.743852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:36.744246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:36.776970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7afb1819-a5be-4cb3-bb86-dce14dc5b8c4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048811 Sep 13 14:20:36.777534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 686/1305] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:37.269502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:37.271547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:37.277510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:37.278024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:37.278457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:37.279147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:37.279594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:37.280011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:37.309509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd016800-3033-41c0-a7d8-56363687dffc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Sep 13 14:20:37.310095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 620/1306] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:37.528453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:37.530612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:37.537180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:37.537658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:37.538138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:37.538833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:37.539287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:37.539710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:37.569501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-23d6890f-04a4-4002-b5b9-3748dbfc1d96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Sep 13 14:20:37.570091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 687/1307] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:37.789995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:37.792079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:37.798450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:37.798926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:37.799353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:37.800774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:37.801225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:37.801647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:37.830006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d029ec2c-f05a-4faf-ac17-84c41914b51b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044034 Sep 13 14:20:37.830558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 621/1308] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:38.321845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:38.323998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:38.330057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:38.330484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:38.331474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:38.332186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:38.332639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:38.333059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:38.362569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-458dd083-0109-44f1-8152-154ec49f3127 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 13 14:20:38.363119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 688/1309] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:38.582247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:38.584341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:38.590266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:38.590738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:38.591191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:38.591870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:38.592317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:38.592737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:38.609444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:38.623661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88a265f8-904b-4b1f-9ec5-cb6b66a9d08c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 13 14:20:38.624221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 622/1310] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:38.843052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:38.845100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:38.851703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:38.852177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:38.852605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:38.853282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:38.853755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:38.854173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:38.882450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e884def-c638-4b8f-a1ad-d0d8a3d4b4aa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043582 Sep 13 14:20:38.882983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 689/1311] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:39.374909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:39.377034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:39.379914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:39.385353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:39.385904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:39.386339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:39.387033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:39.387509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:39.387928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:39.417593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99d609a8-27ea-4018-9f8c-c1511a0d66a0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Sep 13 14:20:39.418181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 623/1312] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:39.636177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:39.638287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:39.644459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:39.644937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:39.645363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:39.646071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:39.646521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:39.646940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:39.675663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f231c76c-ac90-4d3b-9a33-609741fec2c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Sep 13 14:20:39.676208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 690/1313] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:39.895990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:39.898198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:39.904129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:39.904604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:39.905031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:39.905715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:39.906186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:39.906611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:39.935839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7656b9b5-6261-493b-a61a-4fa99d62ac61 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044820 Sep 13 14:20:39.936391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 624/1314] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:40.430225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:40.432387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:40.439313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:40.439778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:40.440208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:40.441023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:40.441420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:40.441862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:40.470476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d8a1f3b-40ec-4945-8467-8fd209b91172 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Sep 13 14:20:40.471015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 691/1315] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:40.687897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:40.690131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:40.696943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:40.697354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:40.697800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:40.698480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:40.698925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:40.699342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:40.728914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e022cc2-ebe7-49b2-8d12-970453c94d4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Sep 13 14:20:40.729453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 625/1316] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:40.948259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:40.950401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:40.957248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:40.957741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:40.958175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:40.958859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:40.959310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:40.959728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:40.988659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c0c4080b-c5a5-4dd8-b5e7-d574b9edbaff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044434 Sep 13 14:20:40.989292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 692/1317] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:41.483660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:41.485835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:41.492366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:41.492858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:41.493293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:41.494005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:41.494457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:41.494877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:41.524300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51dde9b4-59b9-48cc-9a1b-8d3fdef31261 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Sep 13 14:20:41.524792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 626/1318] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:20:41.741596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:41.743898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:41.750473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:41.750959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:41.751394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:41.752085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:41.752540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:41.753220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:41.782670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b3ff22cd-aa2e-46a1-a256-1cd193b3fc00 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045752 Sep 13 14:20:41.783210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 693/1319] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:42.001298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:42.003508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:42.009810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:42.010280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:42.010704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:42.011382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:42.011823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:42.012236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:42.042053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f367da8a-7803-44dc-9a4d-28aba7fd5c67 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044805 Sep 13 14:20:42.042531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 627/1320] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:42.536945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:42.539174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:42.545064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:42.545542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:42.546010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:42.546696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:42.547148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:42.547567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:42.576388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d8814fc7-a001-485d-8d0b-c84313e82197 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Sep 13 14:20:42.576871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 694/1321] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:42.795607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:42.797808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:42.804328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:42.804795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:42.805219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:42.805926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:42.806371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:42.806785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:42.836454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b301e9d-9152-4d4b-847b-cbb57623ce45 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Sep 13 14:20:42.836928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 628/1322] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:43.054581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:43.056720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:43.063010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:43.063482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:43.063912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:43.064592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:43.065042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:43.065459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:43.094356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-96136a45-cb30-4355-9281-a280af3e4fdf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044201 Sep 13 14:20:43.094829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 695/1323] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:43.588754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:43.590980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:43.598418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:43.598901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:43.599334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:43.600024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:43.600478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:43.600899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:43.629953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a7c1de0-34d0-401d-a02c-75433e10120f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Sep 13 14:20:43.630468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 629/1324] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:43.848699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:43.850875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:43.856705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:43.857182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:43.857610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:43.858320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:43.858767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:43.859183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:43.862726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:43.888237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef2ec792-fd9e-46ad-a3b3-457a5553ddcc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Sep 13 14:20:43.888712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 696/1325] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:44.106815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:44.108925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:44.115300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:44.115772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:44.116204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:44.116886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:44.117335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:44.117777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:44.148793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43020536-929c-48b2-b74c-d317cd956f47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045819 Sep 13 14:20:44.149286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 630/1326] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:44.642823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:44.645833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:44.652129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:44.652598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:44.653022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:44.653697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:44.654169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:44.654585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:44.682482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-608ad947-3781-4053-bea0-5cb62bafc5d2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 Sep 13 14:20:44.682962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 697/1327] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:44.900410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:44.902623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:44.909058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:44.909529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:44.909996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:44.910684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:44.911135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:44.911552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:44.941271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6909dacc-40bf-46aa-9f53-869f13db8cb0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Sep 13 14:20:44.941771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 631/1328] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:45.162079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:45.164254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:45.170262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:45.170747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:45.171177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:45.171872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:45.172325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:45.172746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:45.202851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e171160-8d75-467b-8084-0fac1b4a7c74 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044995 Sep 13 14:20:45.203407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 698/1329] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:45.695052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:45.697183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:45.703192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:45.703666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:45.704098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:45.704777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:45.705227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:45.706292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:45.735837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f78ae10-4da0-4871-b887-77414728bd4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Sep 13 14:20:45.736317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 632/1330] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:45.953529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:45.955761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:45.962144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:45.962616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:45.963042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:45.963720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:45.964167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:45.964585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:45.994143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4d92330-3e14-419a-acec-029f06354ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Sep 13 14:20:45.994624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 699/1331] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:46.214859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:46.217068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:46.223965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:46.224432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:46.224853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:46.225530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:46.226000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:46.226446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:46.255391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceedd8f2-6ad1-420f-b8a4-42d2daad1e9e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044427 Sep 13 14:20:46.255863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 633/1332] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:46.747777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:46.749939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:46.756361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:46.756833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:46.757267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:46.757976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:46.758422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:46.758838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:46.788381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7fb52ba-16a3-4091-9a42-bc5c40b8ea01 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Sep 13 14:20:46.788857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 700/1333] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:47.006867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:47.009006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:47.014900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:47.015377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:47.015803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:47.016485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:47.017029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:47.017707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:47.047181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d31d9405-e233-4944-83c8-0b6e6813a592 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Sep 13 14:20:47.047663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 634/1334] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:47.268276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:47.270463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:47.276763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:47.277236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:47.277665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:47.278370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:47.278821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:47.279239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:47.308048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b47d1b99-0b1d-46ca-9073-b522b9fd3788 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044016 Sep 13 14:20:47.308524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 701/1335] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:47.800736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:47.802981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:47.811847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:47.812712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:47.813492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:47.814789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:47.816195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:47.816957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:47.846682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-020fd663-9b4d-4d26-b819-f89a2d7ee7d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049845 Sep 13 14:20:47.847174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 635/1336] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:48.059788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:48.061980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:48.068562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:48.069041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:48.069476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:48.070192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:48.070645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:48.071066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:48.099739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d14aa5e-5ec1-4702-a24e-764005370d88 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Sep 13 14:20:48.100206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 702/1337] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:48.320750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:48.322898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:48.328798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:48.329271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:48.329703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:48.330410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:48.330917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:48.331339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:48.362742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6af7237e-b321-4d67-bf15-90f9ca888796 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044437 Sep 13 14:20:48.363240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 636/1338] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:48.859158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:48.861274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:48.868503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:48.868984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:48.869414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:48.870130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:48.870586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:48.871009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:48.899980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6f0a6b5-779f-4ce4-ba3d-33bd1ec26aa3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044850 Sep 13 14:20:48.900457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 703/1339] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:49.112628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:49.114848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:49.122478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:49.122952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:49.123380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:49.124072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:49.124518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:49.124935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:49.154497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec887e6e-b492-4345-96c6-88d42838537b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046429 Sep 13 14:20:49.154973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 637/1340] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:49.375281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:49.377710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:49.383619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:49.384099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:49.384532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:49.385218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:49.385670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:49.386122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:49.417300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-765c53e3-0ac5-4d85-a4bd-9bcf5811e06f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045972 Sep 13 14:20:49.417809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 704/1341] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:49.912819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:49.915024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:49.920885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:49.921353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:49.921805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:49.922481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:49.922922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:49.923341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:49.951757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6277e37-d5ea-4792-9aef-211a0926d77d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Sep 13 14:20:49.952297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 638/1342] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:50.167881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:50.170042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:50.176820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:50.177313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:50.177770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:50.178468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:50.178926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:50.179354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:50.209771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af828b31-7985-4c15-b73f-8e96caa139df tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045880 Sep 13 14:20:50.210321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 705/1343] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:50.429791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:50.432013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:50.438395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:50.438865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:50.439288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:50.440490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:50.440935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:50.441348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:50.444970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:50.471469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-210748c0-99d9-43e1-88e3-df2a9d8e4b2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045575 Sep 13 14:20:50.472109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 639/1344] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:50.964014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:50.966209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:50.972809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:50.973277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:50.973706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:50.974487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:50.974934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:50.975356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:51.003268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0126d09-3836-4c1b-9eff-bba83a040bf6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Sep 13 14:20:51.003804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 706/1345] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:51.222076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:51.224094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:51.230353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:51.230823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:51.231245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:51.231919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:51.232361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:51.232775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:51.261508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1be3275a-0342-448a-81e4-a47f2f292ac7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Sep 13 14:20:51.262087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 640/1346] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:51.483285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:51.485314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:51.491664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:51.492141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:51.492570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:51.493250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:51.493699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:51.494142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:51.524387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed6d698f-4339-47ec-b140-6e1c296bf0fa tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045154 Sep 13 14:20:51.524944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 707/1347] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:52.015514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:52.017996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:52.024370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:52.024834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:52.025255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:52.026078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:52.026529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:52.026943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:52.056057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c138e897-06f2-4000-9c34-4971f3f9a915 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Sep 13 14:20:52.056604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 641/1348] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:52.275122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:52.277255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:52.283154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:52.283852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:52.284373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:52.285060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:52.285511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:52.285965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:52.314394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-baa65d90-9017-4bea-8a03-1feb9a1922e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Sep 13 14:20:52.315644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 708/1349] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:52.536537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:52.538685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:52.540766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:20:52.540904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:20:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:20:52.551401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:52.551880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:52.552310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:52.553000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:52.553452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:52.553912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:52.584192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f3a7da8-8483-4166-af39-d81f9ed0643a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051670 Sep 13 14:20:52.584746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 642/1350] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:53.068492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:53.070599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:53.076972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:53.077457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:53.077929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:53.078620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:53.079073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:53.079494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:53.109291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ba68831-b128-4ffb-a37e-4c4af3550801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Sep 13 14:20:53.109876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 709/1351] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:53.326760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:53.328836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:53.334958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:53.335430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:53.335860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:53.336537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:53.336984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:53.337402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:53.366966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ebc92dd-0c69-4b6e-bce3-84f6fa77c3e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Sep 13 14:20:53.367729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 643/1352] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:53.597469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:53.599532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:53.605317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:53.605830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:53.606259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:53.606935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:53.607381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:53.607799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:53.636467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d71a3712-316c-4eac-aaef-b9e08558db8f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043670 Sep 13 14:20:53.637000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 710/1353] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:54.121763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:54.123895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:54.130112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:54.130592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:54.131059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:54.131755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:54.132209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:54.132635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:54.162471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a5f3cecb-9fe3-4504-9379-aa0bbeeb899f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Sep 13 14:20:54.163019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 644/1354] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:54.379836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:54.381978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:54.388345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:54.388814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:54.389245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:54.389964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:54.390407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:54.390818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:54.421948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-125a06c6-7506-4668-8135-5035b543bc37 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046508 Sep 13 14:20:54.422486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 711/1355] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:54.649300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:54.651436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:54.657898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:54.658369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:54.659403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:54.660084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:54.660536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:54.660950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:54.689190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19b5444f-4113-4edb-bcea-7945aea1ad53 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043853 Sep 13 14:20:54.689764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 645/1356] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:55.175058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:55.177186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:55.183026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:55.183501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:55.183927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:55.184605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:55.185052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:55.185466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:55.211220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:20:55.216023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec99d444-5a41-4ea0-b34e-752189e536f0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Sep 13 14:20:55.216570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 712/1357] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:55.435014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:55.437109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:55.443724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:55.444190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:55.444614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:55.445290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:55.445746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:55.446169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:55.476358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-202d5be7-62df-470e-a6ee-20695cb4a433 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Sep 13 14:20:55.476912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 646/1358] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:55.702663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:55.704763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:55.707012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:20:55.707160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:20:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:20:55.718795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:55.719267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:55.719697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:55.720379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:55.720826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:55.721881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:55.751093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4796f969-4458-46e0-96f0-a62c8ec3a4c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052842 Sep 13 14:20:55.751628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 713/1359] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:56.228766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:56.230964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:56.237519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:56.238136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:56.238568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:56.239255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:56.239699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:56.240114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:56.269590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39ca3022-c485-4f6e-9b84-e95f87325c56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Sep 13 14:20:56.270174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 647/1360] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:56.488718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:56.490892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:56.496755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:56.497237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:56.497670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:56.498385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:56.498842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:56.499269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:56.532646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4bfe98e0-e35b-4c83-b14c-cc2ea8efef27 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Sep 13 14:20:56.533210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 714/1361] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:56.763320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:56.765429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:56.772304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:56.772783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:56.773219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:56.773945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:56.774402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:56.774826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:56.803329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f54efb0-8ce5-442d-8d4d-93838cbf3f51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044012 Sep 13 14:20:56.803879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 648/1362] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:57.282116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:57.284751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:57.291112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:57.291588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:57.292016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:57.292702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:57.293148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:57.293564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:57.322718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32a0a3c5-d433-410d-b021-7a91984cfb21 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 Sep 13 14:20:57.323271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 715/1363] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:57.544457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:57.546708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:57.553871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:57.554343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:57.554770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:57.555454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:57.555900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:57.556318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:57.585567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da932b8d-ecce-4655-9cb4-63f5deef089a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045072 Sep 13 14:20:57.586148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 649/1364] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:57.816018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:57.818108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:57.824096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:57.824576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:57.825011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:57.825692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:57.826169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:57.826590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:57.857642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88334b33-3059-4359-882c-2ebcb4ac3c1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045882 Sep 13 14:20:57.858224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 716/1365] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:20:58.335950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:58.338134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:58.344147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:58.344617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:58.345043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:58.345738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:58.346488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:58.347039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:58.388408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e0229de-3ad7-4913-8f1c-6eecdf0e6831 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056245 Sep 13 14:20:58.389711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 650/1366] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:58.598468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:58.600600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:58.607099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:58.607579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:58.608011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:58.608698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:58.609153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:58.609608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:58.637901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9766efc5-ba7c-4dfd-9056-7aea460069fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Sep 13 14:20:58.638441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 717/1367] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:58.870171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:58.872283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:58.878733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:58.879214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:58.879648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:58.880340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:58.880793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:58.881218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:58.910362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f6638c9-b59e-48e1-9cc7-5b8cfaf6dc77 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 Sep 13 14:20:58.910911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 651/1368] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:20:59.401472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:59.404125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:59.410887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:59.411383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:59.411824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:59.412518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:59.412971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:59.413390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:59.443069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0022110a-e06e-462b-b3c6-cb2f257dd7bc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045554 Sep 13 14:20:59.443817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 718/1369] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:59.650962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:59.653144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:59.659000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:59.659466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:59.659889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:59.660570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:59.661012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:59.661425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:59.690479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bb54db1-793c-4fa8-ad84-54443f96d3b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 Sep 13 14:20:59.691008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 652/1370] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:20:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:20:59.922864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:20:59.925584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:20:59.931886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:59.932364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:59.932794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:59.933472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:20:59.933958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:20:59.934373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:20:59.963532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a89be16d-4cfe-4622-b121-c3684e3ceb10 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Sep 13 14:20:59.964070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 719/1371] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:20:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:00.455695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:00.457832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:00.464347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:00.464819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:00.465247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:00.465958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:00.466405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:00.466821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:00.497549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0bf66566-82cf-497c-b9bc-73e2cc0f67e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045884 Sep 13 14:21:00.498134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 653/1372] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:00.702758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:00.704871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:00.711426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:00.711901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:00.712330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:00.713004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:00.713451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:00.713980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:00.743515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c90cd8bf-18f0-450a-89a6-d1be16a2b410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Sep 13 14:21:00.744050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 720/1373] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:00.976760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:00.978948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:00.984788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:00.985292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:00.985750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:00.987080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:00.987533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:00.987959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:01.016863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49408a28-e628-498f-976b-7135aaee9bac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044114 Sep 13 14:21:01.017761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 654/1374] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:01.510377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:01.512526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:01.520135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:01.520621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:01.521056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:01.521767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:01.522209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:01.522663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:01.554530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-564eb0b6-a2c8-4a2e-849a-96593e310072 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Sep 13 14:21:01.555089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 721/1375] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:01.756430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:01.758572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:01.764849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:01.765325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:01.765805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:01.766493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:01.766940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:01.767358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:01.792470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:01.797743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2900904f-e271-45f2-8abe-7c099919bdb7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045718 Sep 13 14:21:01.798300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 655/1376] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:02.029972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:02.032040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:02.038024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:02.038508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:02.038950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:02.039644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:02.040103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:02.040533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:02.069583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-81fac3cb-77e4-40a0-982e-4c67ef38232e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043754 Sep 13 14:21:02.070162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 722/1377] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:02.567228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:02.569363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:02.575223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:02.575703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:02.576158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:02.576875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:02.577325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:02.577776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:02.607468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8af3855-0e22-463b-b541-0091068892a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044999 Sep 13 14:21:02.608032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 656/1378] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:02.809870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:02.812106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:02.819075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:02.819547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:02.819972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:02.820651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:02.821100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:02.821517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:02.851003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7278fd74-2513-43e2-9301-df3878a8223d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Sep 13 14:21:02.851529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 723/1379] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:03.082278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:03.084389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:03.090692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:03.091172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:03.091601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:03.092287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:03.092734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:03.093151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:03.121980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f65d3dc0-ce7b-4240-80af-50077c9551c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043853 Sep 13 14:21:03.122523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 657/1380] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:03.619707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:03.621950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:03.628569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:03.629043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:03.629464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:03.630175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:03.630617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:03.631034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:03.661149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2207b14-c91b-4724-aa16-9a09afdbbd3b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Sep 13 14:21:03.661703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 724/1381] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:03.864065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:03.866203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:03.872102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:03.872571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:03.873029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:03.873710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:03.874190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:03.874609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:03.909235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a56101b-9b0c-4ab1-8e56-adf409ff4a3b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049729 Sep 13 14:21:03.909828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 658/1382] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:04.134499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:04.136534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:04.144594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:04.145166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:04.145707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:04.146632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:04.147089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:04.147521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:04.177980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d075d7b-6e4b-429a-a7e1-98ec443d936d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047468 Sep 13 14:21:04.178529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 725/1383] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:04.673342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:04.675979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:04.682349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:04.682835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:04.683264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:04.683953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:04.684404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:04.684826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:04.725457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f72a22a3-f9d4-4069-9322-091c9f683b0b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055957 Sep 13 14:21:04.726056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 659/1384] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:04.921340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:04.923530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:04.926025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:04.931270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:04.931754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:04.932184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:04.932876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:04.933337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:04.933786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:04.961913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c375fd9-e31f-485c-a880-25d0be96e4b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Sep 13 14:21:04.962460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 726/1385] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:05.190617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:05.192711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:05.198817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:05.199329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:05.199766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:05.200458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:05.200910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:05.201332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:05.231417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75a625db-d8e2-4559-bbe1-fc283a7cd5f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044990 Sep 13 14:21:05.231970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 660/1386] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:05.737759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:05.739901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:05.746427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:05.746911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:05.747347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:05.748037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:05.748493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:05.748922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:05.779417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c64e858d-053d-4b8f-93aa-7f25c734ebbb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Sep 13 14:21:05.779906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 727/1387] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:05.974485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:05.976601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:05.982998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:05.983469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:05.983898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:05.984579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:05.985024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:05.985438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:06.015053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4864237a-017c-49fc-ba77-62c56467f356 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Sep 13 14:21:06.015597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 661/1388] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:06.243837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:06.246031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:06.252601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:06.253082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:06.253516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:06.254230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:06.254684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:06.255106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:06.284537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3bf10b51-7e7e-4fa1-a433-de68740b35c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Sep 13 14:21:06.285083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 728/1389] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:06.791437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:06.793801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:06.800471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:06.800942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:06.801367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:06.802095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:06.802536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:06.802951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:06.841367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eda22654-342e-4bac-b2a2-766ea7bee20c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053854 Sep 13 14:21:06.841968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 662/1390] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:07.027769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:07.030194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:07.037302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:07.037898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:07.038368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:07.039056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:07.039509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:07.039929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:07.056713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:07.069883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37d8d6f3-8b69-41ab-a8f6-0255b302c410 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046059 Sep 13 14:21:07.070436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 729/1391] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:21:07.297325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:07.299725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:07.306054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:07.306527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:07.306953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:07.307634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:07.308078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:07.308495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:07.338143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7e092b5-96b9-4e1b-a39e-9c9db7dae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044842 Sep 13 14:21:07.338696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 663/1392] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:07.854053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:07.856234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:07.862670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:07.863155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:07.863587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:07.864287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:07.864740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:07.865169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:07.900331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e62627a-3e8a-4e15-9ecf-c2d9f57ecc00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Sep 13 14:21:07.900895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 730/1393] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:08.083504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:08.085657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:08.092106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:08.092593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:08.093032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:08.093746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:08.094214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:08.094638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:08.125011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50cacb5c-c856-4ee4-9c72-6d37395d9171 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Sep 13 14:21:08.125566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 664/1394] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:08.350942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:08.353087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:08.360275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:08.360765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:08.361253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:08.362003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:08.362446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:08.362865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:08.397162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cbd55340-47a2-4c8c-b812-dfe882829279 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050375 Sep 13 14:21:08.397851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 731/1395] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:08.913190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:08.915355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:08.921616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:08.922124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:08.922560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:08.923243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:08.923691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:08.924114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:08.953579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c8816ba-987a-4122-b9d8-497a47beaf42 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Sep 13 14:21:08.954377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 665/1396] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:21:09.147461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:09.149536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:09.155687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:09.156324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:09.156763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:09.157528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:09.158814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:09.159287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:09.187379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2a1de241-f7f0-4bfd-adc5-60193a9656fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Sep 13 14:21:09.187928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 732/1397] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:09.410123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:09.412176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:09.414065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:09.419260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:09.419742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:09.420173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:09.420859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:09.421309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:09.421746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:09.451425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6622b6b8-89e6-481d-b325-e5660ee6882c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046024 Sep 13 14:21:09.451983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 666/1398] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:09.965488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:09.967680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:09.974223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:09.974699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:09.975127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:09.975815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:09.976264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:09.976744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:10.007056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9eb0d6ce-7e84-4ccd-9682-bcc6f5d9934b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Sep 13 14:21:10.007769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 733/1399] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:10.200179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:10.202345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:10.209347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:10.209856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:10.210284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:10.210972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:10.211416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:10.211832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:10.240524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c627db4e-0898-4cc6-bbc6-ed6fcd26b94c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Sep 13 14:21:10.241072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 667/1400] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:10.464825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:10.466921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:10.472951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:10.473427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:10.473885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:10.474565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:10.475016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:10.475431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:10.504834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-194011b2-9557-4ab1-9eb2-14eb47b688a4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044093 Sep 13 14:21:10.505375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 734/1401] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:11.020303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:11.022482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:11.028292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:11.028768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:11.029191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:11.029899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:11.030344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:11.030759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:11.059945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7345ba43-e10d-41cf-9a76-7bda2b6fcdbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Sep 13 14:21:11.060502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 668/1402] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:11.253103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:11.255335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:11.261951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:11.262459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:11.262836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:11.263535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:11.263989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:11.264409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:11.294338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd9704b9-dd25-49d5-a544-a8bc75b78144 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045755 Sep 13 14:21:11.294889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 735/1403] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:11.517608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:11.519935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:11.526598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:11.527082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:11.527705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:11.528190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:11.528640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:11.529091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:11.559380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c7607eee-c91d-4d64-8ff4-1ca9eadef9c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046151 Sep 13 14:21:11.559949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 669/1404] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:12.071979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:12.074165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:12.081134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:12.081610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:12.082076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:12.082764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:12.083275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:12.083695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:12.113718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d280006-6eca-4777-8a7e-a1ed1a3a719d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Sep 13 14:21:12.114488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 736/1405] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:12.307283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:12.309573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:12.315540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:12.316059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:12.316522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:12.317215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:12.317659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:12.318148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:12.347558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06bc7313-7a37-412c-bd51-bc006e608b89 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Sep 13 14:21:12.348102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 670/1406] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:12.572016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:12.574193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:12.581129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:12.581608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:12.582069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:12.582759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:12.583211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:12.583628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:12.613285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-600fab6d-4ae0-4821-8d9b-f389d4ce71ad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045259 Sep 13 14:21:12.613857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 737/1407] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:13.125343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:13.127489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:13.130463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:21:13.130638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:21:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:21:13.136828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:13.137299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:13.137742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:13.138438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:13.138880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:13.139299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:13.170028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a5c269b-e73b-43de-a605-ba270a6a85d4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048531 Sep 13 14:21:13.170593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 671/1408] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:13.360785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:13.363559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:13.369855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:13.370461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:13.370896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:13.371598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:13.372039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:13.372462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:13.403160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b30344f4-ba63-4cb7-a8f9-d3344fe84dd9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Sep 13 14:21:13.403672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 738/1409] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:13.625839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:13.627947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:13.634567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:13.635040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:13.635464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:13.636144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:13.636591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:13.637009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:13.653287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:13.667716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c2a4f4e-ff89-4241-a428-a44764397b7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045918 Sep 13 14:21:13.668275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 672/1410] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:14.182592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:14.184738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:14.192022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:14.192504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:14.192934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:14.193657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:14.194133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:14.194559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:14.226921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-464b212d-537b-4d76-9b4c-2af4998ff4b3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048308 Sep 13 14:21:14.227489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 739/1411] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:14.416159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:14.418717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:14.425639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:14.426369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:14.426842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:14.427768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:14.428236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:14.428639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:14.458474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e40e050-62fb-4a39-94a8-dc051f8788a2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Sep 13 14:21:14.459033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 673/1412] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:14.680521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:14.682611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:14.688805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:14.689280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:14.689709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:14.690411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:14.690859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:14.691281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:14.719531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-650b7adf-5c98-45cc-8cd4-0c6c247fb353 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043100 Sep 13 14:21:14.720079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 740/1413] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:15.240090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:15.242254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:15.248337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:15.248891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:15.249323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:15.250140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:15.250586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:15.251421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:15.280736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a7558e7-3657-435c-8b22-4486d31c4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Sep 13 14:21:15.281371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 674/1414] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:15.470747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:15.473552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:15.480580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:15.481064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:15.481494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:15.482321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:15.482776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:15.483197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:15.516134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-52bb0740-780d-4ae7-a396-1e37fd3dec82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049358 Sep 13 14:21:15.516724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 741/1415] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:15.732482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:15.734647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:15.741261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:15.741754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:15.742199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:15.742884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:15.743333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:15.743762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:15.772758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-906661a4-1225-4a92-9a9f-b746ad504981 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044257 Sep 13 14:21:15.773298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 675/1416] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:16.293774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:16.295848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:16.302717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:16.303200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:16.303637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:16.304317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:16.304768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:16.305188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:16.334627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-baa59aac-48c4-4fb5-84ca-8ea29b9aba23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Sep 13 14:21:16.335196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 742/1417] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:16.528514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:16.530716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:16.537364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:16.537871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:16.538300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:16.538983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:16.539427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:16.539841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:16.569233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6aac46f6-5b23-4b64-8070-ebce3c8b7b7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Sep 13 14:21:16.569713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 676/1418] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:16.785195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:16.787398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:16.793420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:16.793968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:16.794406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:16.795100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:16.795555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:16.795978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:16.825341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f65f5843-44f2-4a37-9773-fe9d3ba8c496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Sep 13 14:21:16.825841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 743/1419] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:17.347103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:17.349349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:17.355800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:17.356271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:17.356700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:17.357375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:17.357849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:17.358269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:17.390648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9564cf2d-f4ca-49c1-bfe3-f4ad5f774b9c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Sep 13 14:21:17.391234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 677/1420] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:17.581932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:17.584104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:17.590578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:17.591056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:17.591486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:17.592170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:17.592620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:17.593041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:17.621862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf42af4f-e817-4762-9d40-8c7cc5556358 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Sep 13 14:21:17.622347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 744/1421] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:17.837292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:17.839413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:17.845235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:17.845706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:17.846165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:17.846880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:17.847323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:17.847741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:17.876848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79e0ac6a-9545-4c18-9c82-0a061edb2775 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043421 Sep 13 14:21:17.877327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 678/1422] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:18.403584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:18.405833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:18.412658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:18.413141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:18.413579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:18.414310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:18.414767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:18.415197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:18.445104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7d86c093-3802-4455-a697-29d52aab46a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Sep 13 14:21:18.445663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 745/1423] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:18.634698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:18.636806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:18.643388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:18.644102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:18.644526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:18.645207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:18.645652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:18.646096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:18.675368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-826e2f9e-b33d-4d66-95c1-7dae5b99e826 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Sep 13 14:21:18.675844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 679/1424] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:18.889599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:18.891771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:18.898422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:18.898903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:18.899335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:18.900050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:18.900504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:18.900925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:18.904548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:18.931625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-105c6cb3-b6fb-4edc-8f12-e5ad23370ebf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045957 Sep 13 14:21:18.932101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 746/1425] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:19.458225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:19.460437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:19.466388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:19.466856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:19.467283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:19.467960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:19.468406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:19.468852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:19.497798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-90105a0e-ab07-47b9-83b5-977c60fe69ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Sep 13 14:21:19.498529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 680/1426] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:19.688132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:19.690293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:19.696885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:19.697365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:19.697826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:19.698512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:19.698965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:19.699389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:19.728378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6672ca72-e5b1-4a71-b155-8b85a6d897c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Sep 13 14:21:19.728846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 747/1427] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:19.943985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:19.946185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:19.952578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:19.953048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:19.953478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:19.954192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:19.954643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:19.955064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:19.989670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fc1a315b-f9f7-48ff-b9eb-ccd8fc525155 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049647 Sep 13 14:21:19.990179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 681/1428] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:20.510368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:20.512501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:20.519920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:20.520404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:20.520835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:20.521528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:20.522014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:20.522436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:20.551348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d8b3e31-cb02-4621-bf36-6e5831972601 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 Sep 13 14:21:20.552173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 748/1429] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:20.740236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:20.742382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:20.748303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:20.748793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:20.749203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:20.749928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:20.750381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:20.750801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:20.780933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff46c0ba-2a8f-4e4f-b523-7f6b46d27e4a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Sep 13 14:21:20.781471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 682/1430] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:21.002343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:21.005010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:21.010873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:21.011349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:21.011776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:21.012451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:21.012896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:21.013313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:21.042016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d9538d6c-e91c-4e76-829a-971f9c8288c8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043791 Sep 13 14:21:21.042583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 749/1431] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:21.563731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:21.566919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:21.573303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:21.573810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:21.574247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:21.574944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:21.575393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:21.575811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:21.604541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e90c5475-2094-4230-bfc4-250f1d307d94 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044786 Sep 13 14:21:21.605317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 683/1432] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:21.792863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:21.794960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:21.801746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:21.802227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:21.802653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:21.803449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:21.803901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:21.804319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:21.833188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8208e7e1-349a-4c91-b350-3be2bcdf882c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Sep 13 14:21:21.833718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 750/1433] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:22.054813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:22.056828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:22.062689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:22.063163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:22.063590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:22.064274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:22.064721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:22.065137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:22.093305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14a4650c-3b97-44ff-91d3-7a9f4eed8dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043306 Sep 13 14:21:22.093870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 684/1434] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:22.617348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:22.619531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:22.625456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:22.625972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:22.626409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:22.627089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:22.627542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:22.628789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:22.657269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c1886827-90f9-404f-987b-251b2dae7e32 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Sep 13 14:21:22.657842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 751/1435] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:22.845462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:22.848081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:22.854482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:22.854988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:22.855422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:22.856103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:22.856555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:22.856982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:22.885977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-298e6534-c5f1-4a0c-826c-66e4d3b53e7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Sep 13 14:21:22.886536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 685/1436] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:23.106179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:23.108287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:23.114719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:23.115202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:23.115638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:23.116326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:23.116778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:23.117198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:23.146484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c9a5acf0-3cbb-41aa-850f-033ac3b3ebbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044365 Sep 13 14:21:23.147023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 752/1437] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:23.670450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:23.672600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:23.679669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:23.680147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:23.680587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:23.681290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:23.681761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:23.682217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:23.711251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eade1793-80ba-4b8e-8833-792100bc4dc1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Sep 13 14:21:23.711818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 686/1438] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:23.899354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:23.901494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:23.907385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:23.907870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:23.908309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:23.909181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:23.909831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:23.910258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:23.939421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-45b2ceee-e888-441a-a241-e5a188ee067e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043990 Sep 13 14:21:23.939981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 753/1439] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:24.158202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:24.160982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:24.166869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:24.167339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:24.167765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:24.168451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:24.168967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:24.169386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:24.198592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f2c6016-ee75-448b-b193-cb82cd189a0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044472 Sep 13 14:21:24.199138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 687/1440] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:24.723384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:24.725674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:24.732150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:24.732637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:24.733079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:24.733801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:24.734329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:24.734761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:24.765199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d66ca0a5-e465-4559-addf-d870d301e31b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Sep 13 14:21:24.765866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 754/1441] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:24.952475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:24.954630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:24.960921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:24.961395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:24.961869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:24.962558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:24.963007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:24.963459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:24.994499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-109e97de-4d2b-46df-a07a-b8c032f69226 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045807 Sep 13 14:21:24.994993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 688/1442] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:25.211079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:25.213328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:25.219109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:25.219585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:25.220010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:25.220687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:25.221132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:25.221714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:25.249837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-493a9619-dd57-4678-b9bc-7bf215c1ab59 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042667 Sep 13 14:21:25.250310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 755/1443] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:25.778342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:25.780428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:25.787268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:25.787740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:25.788166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:25.788847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:25.789290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:25.789708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:25.793218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:25.819449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cd4362d-f81a-41d4-8a45-d13cde3f76f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Sep 13 14:21:25.819998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 689/1444] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:26.007086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:26.009215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:26.015566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:26.016045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:26.016477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:26.017160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:26.017911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:26.019017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:26.048544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c67e63e0-45b2-4b9c-b80e-d51011645ba8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Sep 13 14:21:26.049022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 756/1445] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:21:26.262381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:26.264493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:26.271166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:26.271667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:26.272096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:26.272780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:26.273228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:26.273650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:26.302767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08c145f7-083b-4956-a423-f7ac00313755 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044229 Sep 13 14:21:26.303247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 690/1446] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:26.831884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:26.834675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:26.840509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:26.840980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:26.841407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:26.842114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:26.842565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:26.843016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:26.871590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e3e5e9bf-5636-42e7-a8ca-ca86a6dff578 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Sep 13 14:21:26.872133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 757/1447] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:27.061351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:27.063538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:27.069434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:27.069966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:27.070403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:27.071098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:27.071552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:27.071974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:27.101795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e6b86cf-4f98-4965-8e70-96d84ebf4b33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Sep 13 14:21:27.102280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 691/1448] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:27.314925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:27.317608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:27.324071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:27.324546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:27.324971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:27.325652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:27.326151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:27.326568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:27.355963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8c30eb1e-9852-4d3b-ba24-f4b5ad5abe6c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044894 Sep 13 14:21:27.356436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 758/1449] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:27.884388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:27.886555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:27.893273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:27.893746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:27.894191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:27.895540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:27.895985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:27.896403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:27.924259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed2d578c-6ebd-4c77-bc00-f7f9b6401b6f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 Sep 13 14:21:27.924811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 692/1450] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:28.114258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:28.116395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:28.122434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:28.122911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:28.123344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:28.124033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:28.124487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:28.124905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:28.155260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-adc42103-01f6-4314-809a-b3eca710c8ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Sep 13 14:21:28.155741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 759/1451] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:28.368410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:28.370705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:28.376745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:28.377223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:28.377658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:28.378369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:28.378823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:28.379247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:28.409201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-889bdfd0-9fe3-43ce-a7c5-f735056ed18f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044684 Sep 13 14:21:28.409685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 693/1452] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:28.936607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:28.938746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:28.945533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:28.946037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:28.946463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:28.947136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:28.947583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:28.948000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:28.976488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e669eec5-8242-4225-9e18-d69082c061e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Sep 13 14:21:28.977026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 760/1453] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:29.167149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:29.169302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:29.175621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:29.176693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:29.177281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:29.178074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:29.178529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:29.178946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:29.208104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00b15aed-4edc-4634-b93e-a7b62fc369e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Sep 13 14:21:29.208653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 694/1454] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:29.422228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:29.424377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:29.430284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:29.430768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:29.431196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:29.431877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:29.432326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:29.432740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:29.462041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53b7f2f3-2592-42b0-971f-4a664ab77bdc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043601 Sep 13 14:21:29.462518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 761/1455] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:29.988828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:29.991603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:29.997521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:29.998026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:29.998458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:29.999144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:29.999624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:30.000046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:30.029423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc622253-af08-4b4e-a044-17db43582aa7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 13 14:21:30.030023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 695/1456] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:30.220271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:30.222428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:30.229434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:30.229946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:30.230381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:30.231064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:30.231517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:30.231940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:30.257202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:30.262392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eaccd64c-8dbf-40b7-a9b5-00266ea673d4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046079 Sep 13 14:21:30.262947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 762/1457] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:30.474721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:30.476839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:30.483206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:30.483693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:30.484126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:30.484814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:30.485268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:30.485690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:30.515217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9de9ff59-2c78-4a55-af44-ad15c79f2dd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044814 Sep 13 14:21:30.515704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 696/1458] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:31.042053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:31.044201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:31.050251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:31.050729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:31.051158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:31.051841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:31.052285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:31.052700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:31.081031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-29168d3a-90b3-4d2d-8413-635d5701c7b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Sep 13 14:21:31.081571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 763/1459] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:21:31.274901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:31.277028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:31.282888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:31.283360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:31.283786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:31.284460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:31.284931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:31.285347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:31.314280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2741174-ee5c-4776-9194-0e789aaed0c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Sep 13 14:21:31.314750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 697/1460] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:31.528030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:31.529964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:31.537342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:31.537927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:31.538364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:31.539062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:31.539522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:31.539947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:31.568426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bd43c227-aad1-4932-acb7-731bd60d8b1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044637 Sep 13 14:21:31.568912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 764/1461] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:32.093214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:32.095332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:32.101830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:32.102304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:32.102730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:32.103414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:32.103862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:32.104280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:32.133077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b96ee49a-2403-46a2-9dc8-795822414cb0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Sep 13 14:21:32.133615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 698/1462] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:21:32.327103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:32.329220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:32.335469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:32.335976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:32.336407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:32.337092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:32.337543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:32.337997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:32.368151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d66dcd1-7046-4346-8089-e4d3671db054 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Sep 13 14:21:32.368630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 765/1463] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:32.580377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:32.582555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:32.588565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:32.589042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:32.589472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:32.590189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:32.590642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:32.591062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:32.620824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-021a03fb-602a-42ef-ae75-448a56121061 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044275 Sep 13 14:21:32.621315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 699/1464] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:33.145773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:33.147907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:33.154356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:33.154837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:33.155272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:33.155958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:33.156412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:33.156835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:33.186202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f50ba95-381c-4702-bc6b-007fcf8cbabd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Sep 13 14:21:33.186744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 766/1465] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:33.379804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:33.381965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:33.388283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:33.388754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:33.389182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:33.389896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:33.390341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:33.390757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:33.420168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7256a944-695a-4262-992e-1cb8b3c089b2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Sep 13 14:21:33.420647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 700/1466] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:33.633099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:33.635258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:33.641131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:33.641609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:33.642087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:33.643040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:33.643495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:33.643919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:33.672383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c0b97d15-3810-4407-a13a-cc952d60809d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043905 Sep 13 14:21:33.672867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 767/1467] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:34.198492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:34.200768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:34.206711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:34.207180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:34.207603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:34.208336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:34.208779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:34.209223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:34.238926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c495607e-fd18-4fe8-b6f6-833b4fe2eaab tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Sep 13 14:21:34.240140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 701/1468] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:34.433019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:34.435229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:34.441305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:34.441805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:34.442363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:34.443161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:34.443612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:34.444030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:34.473113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b7ad2af-6cb6-4514-9a2c-c8d5fe38d172 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Sep 13 14:21:34.474359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 768/1469] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:34.684505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:34.686640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:34.693482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:34.694016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:34.694451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:34.695142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:34.695592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:34.696012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:34.866830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38d1971e-13c3-445d-b67c-566263800adb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.186278 Sep 13 14:21:34.867402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 702/1470] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:35.254111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:35.256398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:35.258312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:35.263961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:35.264453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:35.264887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:35.265583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:35.266063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:35.266493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:35.296468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc2c6715-d4de-418b-85d0-c03fe08656ee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046390 Sep 13 14:21:35.297017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 769/1471] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:21:35.486295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:35.488383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:35.494391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:35.494860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:35.495285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:35.495960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:35.496405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:35.496820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:35.527178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5494876a-2948-423a-8467-d35cffdb39a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Sep 13 14:21:35.528108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 703/1472] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:35.879328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:35.882058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:35.888381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:35.888861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:35.889291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:35.890012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:35.890456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:35.890881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:35.920024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e955daa0-585b-4812-be1c-86fabfe41399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 Sep 13 14:21:35.920566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 770/1473] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:36.308125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:36.310330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:36.316701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:36.317791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:36.318253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:36.318935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:36.319386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:36.319806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:36.348249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36990e45-269d-475f-bab8-b8cd13c64654 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Sep 13 14:21:36.348834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 704/1474] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:36.539318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:36.541584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:36.547598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:36.548078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:36.548522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:36.549209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:36.549665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:36.550112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:36.580264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-056893eb-cb5e-42c4-97b4-2df0cfa47ee8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 13 14:21:36.580744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 771/1475] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:36.933411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:36.935457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:36.941369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:36.941880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:36.942377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:36.943063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:36.943506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:36.943923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:36.967829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:36.972923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a19e4ffc-55f6-4837-b339-331d83792c29 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043653 Sep 13 14:21:36.973467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 705/1476] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:37.360708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:37.362922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:37.369319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:37.369840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:37.370280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:37.370963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:37.371415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:37.371844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:37.400948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d5b7c77c-3d80-4cbe-b293-78c3e4d01b3d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Sep 13 14:21:37.401503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 772/1477] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:37.592784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:37.594979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:37.601631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:37.602141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:37.602572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:37.603271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:37.603724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:37.604145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:37.633661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00b3a909-1359-466c-8d52-a37ad36f1ddc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Sep 13 14:21:37.634176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 706/1478] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:37.986415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:37.988614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:37.995101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:37.995582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:37.996014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:37.996697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:37.997148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:37.997567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:38.026933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ee25520-4c74-4b65-9fec-acfc4c41ddce tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044568 Sep 13 14:21:38.027474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 773/1479] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:38.413547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:38.415770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:38.421971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:38.422458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:38.423025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:38.424186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:38.424651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:38.425082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:38.461999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-33f18c98-c9bb-48b2-9640-de96c692dd99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053148 Sep 13 14:21:38.462600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 707/1480] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:38.646349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:38.648517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:38.656106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:38.656591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:38.657023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:38.658008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:38.658203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:38.658626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:38.693761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d296969-ecd3-4d4e-9830-06c42905fea5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050310 Sep 13 14:21:38.694329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 774/1481] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:39.038698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:39.041514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:39.047925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:39.048397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:39.048825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:39.049513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:39.049990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:39.050411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:39.079348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d912aa2-0b3b-4d5f-82bb-f7127f522c2b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Sep 13 14:21:39.079910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 708/1482] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:39.474765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:39.476879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:39.482788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:39.483264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:39.483692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:39.484368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:39.484822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:39.485241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:39.515002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-04baf3cd-c1c7-4d15-b653-f960b3d64e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Sep 13 14:21:39.515549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 775/1483] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:39.706338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:39.708488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:39.710384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:39.715678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:39.716152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:39.716582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:39.717263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:39.717710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:39.718153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:39.748699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-650619da-f8bb-4be4-bf33-aa2c365784e6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Sep 13 14:21:39.749179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 709/1484] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:40.092761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:40.094892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:40.101959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:40.102436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:40.102883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:40.103545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:40.103992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:40.104410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:40.133548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0590ec62-5f15-4d5b-a0e9-02503d4b07c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044881 Sep 13 14:21:40.134112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 776/1485] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:40.528496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:40.530660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:40.537716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:40.538394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:40.538826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:40.539520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:40.539969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:40.540386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:40.569508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a8da863-a563-4a89-9d4a-9741ef0f4ef4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Sep 13 14:21:40.570088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 710/1486] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:40.761068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:40.763205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:40.769330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:40.769842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:40.770274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:40.770956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:40.772294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:40.772735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:40.801175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1aee1337-ab7b-49df-9d4e-5e82674b8127 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043908 Sep 13 14:21:40.801651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 777/1487] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:41.146396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:41.148611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:41.154533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:41.155004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:41.155428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:41.156137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:41.156580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:41.156994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:41.185657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1a80977-effe-45c4-9989-bff7b199275e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043612 Sep 13 14:21:41.186217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 711/1488] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:41.582163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:41.584316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:41.590650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:41.591118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:41.591547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:41.592220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:41.592670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:41.593083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:41.621865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ca62df1-ba22-4e54-87a6-0f05f6e9dfea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043733 Sep 13 14:21:41.622405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 778/1489] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:41.813106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:41.815266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:41.823067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:41.823517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:41.823943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:41.824619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:41.825069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:41.825487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:41.855386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b902fc8-0d85-4aed-8c7b-e5cecb1cb00d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Sep 13 14:21:41.855933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 712/1490] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:42.197909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:42.200048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:42.206062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:42.206544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:42.207005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:42.207689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:42.208143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:42.209197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:42.225662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:42.238827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a36d8ab2-8319-40dd-9e38-fb90aca49d22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Sep 13 14:21:42.239374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 779/1491] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:42.635249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:42.637359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:42.643590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:42.644061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:42.644487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:42.645168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:42.645614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:42.646091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:42.673972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8fb60e8f-4b84-497a-950b-a63d55ecafbd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Sep 13 14:21:42.674520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 713/1492] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:42.868408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:42.870585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:42.876934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:42.877417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:42.877887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:42.878580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:42.879038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:42.879473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:42.908401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d8a419e3-21ab-4b5b-8788-cce6ffb25762 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Sep 13 14:21:42.908948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 780/1493] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:43.251332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:43.253466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:43.260053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:43.260528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:43.260957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:43.261640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:43.262114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:43.262531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:43.292517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f88e275e-67bf-4da4-8acb-f3b54d4c1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045163 Sep 13 14:21:43.293062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 714/1494] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:43.686909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:43.689032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:43.695541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:43.696021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:43.696454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:43.697141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:43.697595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:43.698044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:43.727204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ea6596c0-77d5-437c-8c0f-3a4a4da74d82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044247 Sep 13 14:21:43.727756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 781/1495] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:43.920605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:43.922747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:43.928675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:43.929150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:43.929600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:43.930295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:43.930743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:43.931162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:43.960639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a54faf0d-1690-4e51-ac4c-b508b3a4503b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Sep 13 14:21:43.961190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 715/1496] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:44.305143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:44.307353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:44.313779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:44.314265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:44.314731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:44.315412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:44.315855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:44.316272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:44.345714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-24f6cffb-e880-42b0-893a-46559b48cdfb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045139 Sep 13 14:21:44.346272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 782/1497] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:44.739579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:44.741720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:44.748067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:44.748567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:44.748998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:44.749672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:44.750156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:44.750571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:44.779320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99c29622-0ff6-47f3-aeca-1ed365d009cb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Sep 13 14:21:44.779854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 716/1498] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:44.972377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:44.975173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:44.980990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:44.981465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:44.981925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:44.982607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:44.983054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:44.983471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:45.012248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0e60ebdd-f58e-4cd4-9097-7a210d226bd3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Sep 13 14:21:45.012767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 783/1499] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:45.358705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:45.360941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:45.367189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:45.367660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:45.368090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:45.368775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:45.369224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:45.369647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:45.399878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63837f86-3d4d-4e8f-9ecf-245ee324a4d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045064 Sep 13 14:21:45.400409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 717/1500] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:45.791372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:45.793444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:45.799800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:45.800270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:45.800692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:45.801368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:45.801847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:45.802903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:45.831369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8decee39-0a70-47b4-a9d8-34ac3d6104e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043986 Sep 13 14:21:45.831904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 784/1501] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:46.025508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:46.027848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:46.034279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:46.034752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:46.035179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:46.035867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:46.036312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:46.037230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:46.067421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8125c0f2-ba81-47b6-a691-43757ed09a31 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Sep 13 14:21:46.068116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 718/1502] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:46.413315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:46.415620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:46.421747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:46.422246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:46.422680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:46.423364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:46.423816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:46.424237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:46.452637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c90576a-1d12-4e6d-b7b1-d6c6465da995 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044130 Sep 13 14:21:46.453180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 785/1503] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:46.842957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:46.845082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:46.851497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:46.851946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:46.852370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:46.853047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:46.853491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:46.853934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:46.882945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f5379cf-835c-488d-a519-d32857d42486 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Sep 13 14:21:46.883574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 719/1504] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:47.079729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:47.081875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:47.088423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:47.088899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:47.089325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:47.090036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:47.090484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:47.090900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:47.120035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af467630-ac83-44af-b1d7-9949a4fc702d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Sep 13 14:21:47.120514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 786/1505] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:47.465800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:47.468355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:47.475165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:47.475651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:47.476084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:47.476781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:47.477234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:47.477808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:47.507820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcf0cf5d-6e7c-47e3-bded-ee27f27af916 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046543 Sep 13 14:21:47.508372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 720/1506] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:47.895844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:47.898033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:47.904359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:47.904837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:47.905269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:47.905975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:47.906432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:47.906854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:47.935266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6d0e229d-4647-4d06-b3d5-02fba2e9eb65 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Sep 13 14:21:47.935812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 787/1507] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:48.132264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:48.134488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:48.140480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:48.140950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:48.141375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:48.142327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:48.142782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:48.143200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:48.173315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64bd164e-6670-45c7-86ad-ee4d4f0b8dbd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Sep 13 14:21:48.173801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 721/1508] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:48.520647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:48.522925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:48.528998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:48.529477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:48.529946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:48.530628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:48.531109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:48.531526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:48.561546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2dd017a1-1e30-48db-b67d-fe31e0f69407 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045099 Sep 13 14:21:48.562130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 788/1509] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:48.947685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:48.949813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:48.956271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:48.956750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:48.957173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:48.957882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:48.958332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:48.958786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:48.975483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:48.988480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df297e9e-a869-4d1d-886b-c73668d708d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044720 Sep 13 14:21:48.989023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 722/1510] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:49.186416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:49.188662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:49.195306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:49.195781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:49.196217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:49.196897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:49.197344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:49.197836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:49.227174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b69a20ae-7682-4d77-aa96-3556850dc509 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Sep 13 14:21:49.227714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 789/1511] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:49.574006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:49.576111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:49.582009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:49.582477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:49.582900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:49.584272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:49.584782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:49.585198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:49.613420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2c45f39-3af0-40a4-a911-49ebd60069ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043388 Sep 13 14:21:49.613989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 723/1512] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:50.002619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:50.004787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:50.011362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:50.011843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:50.012276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:50.012962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:50.013489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:50.013944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:50.042538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0402ae51-08f0-4015-9f6c-a7ba32170e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Sep 13 14:21:50.043089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 790/1513] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:50.240915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:50.243151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:50.249571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:50.250078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:50.250509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:50.251192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:50.251636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:50.252062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:50.281658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4941f18b-1d44-4bfd-8851-a45a63a11e35 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Sep 13 14:21:50.282161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 724/1514] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:50.628035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:50.630402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:50.637113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:50.637799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:50.638043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:50.638929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:50.639078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:50.639528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:50.670017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88f5464b-ef07-4503-9226-f0fe3c31b78a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047422 Sep 13 14:21:50.670568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 791/1515] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:51.055039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:51.057209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:51.063171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:51.063651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:51.064111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:51.064796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:51.065244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:51.065665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:51.094519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0674957-484e-4918-b276-88ce5e40f569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Sep 13 14:21:51.095066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 725/1516] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:51.294581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:51.297259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:51.303360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:51.303849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:51.304283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:51.305016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:51.305524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:51.305929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:51.335895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67aa3b3b-cf2f-4502-8001-2924c13f716e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045248 Sep 13 14:21:51.336452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 792/1517] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:51.682408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:51.684535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:51.690926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:51.691400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:51.691837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:51.692595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:51.693674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:51.694122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:51.723185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74fe7de5-de1f-40eb-8163-22f0b121c46d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044676 Sep 13 14:21:51.724036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 726/1518] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:52.106358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:52.108537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:52.115661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:52.116142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:52.116573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:52.117264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:52.117714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:52.118156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:52.152101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a49b7cd7-d0fb-48b5-bf95-0abc247fc599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049680 Sep 13 14:21:52.152654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 793/1519] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:52.348354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:52.351138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:52.357059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:52.357793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:52.358219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:52.358903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:52.359346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:52.359775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:52.388417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec07d409-12d6-4fc7-92f4-25b9580f3d47 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Sep 13 14:21:52.388955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 727/1520] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:52.735965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:52.738129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:52.744353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:52.744831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:52.745256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:52.745966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:52.746412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:52.746829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:52.777084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d50dd84e-866d-4f6c-83da-d9bc9405e827 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045130 Sep 13 14:21:52.777621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 794/1521] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:53.164395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:53.166567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:53.172590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:53.173059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:53.173486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:53.174203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:53.174645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:53.175061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:53.204402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b148375-22c4-4311-b502-1b7aa8e93537 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Sep 13 14:21:53.204949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 728/1522] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:53.400547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:53.402708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:53.409063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:53.409504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:53.410035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:53.410790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:53.411242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:53.412151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:53.441755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f48979e-8484-48ae-b767-f8f5d20e3151 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Sep 13 14:21:53.442251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 795/1523] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:53.790105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:53.792254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:53.798104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:53.798574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:53.799001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:53.799678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:53.800154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:53.800567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:53.828579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6717999-8932-478f-b3c4-2b2b954dc80c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043044 Sep 13 14:21:53.829122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 729/1524] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:54.216600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:54.218755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:54.224709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:54.225184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:54.225615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:54.226317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:54.226763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:54.227176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:54.230731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:21:54.256059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-02fce2e3-f188-4160-9a0e-204e62247be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042944 Sep 13 14:21:54.256596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 796/1525] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:54.453911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:54.456050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:54.463509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:54.463988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:54.464419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:54.465110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:54.465762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:54.466186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:54.496604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2008070-12b6-4283-b78b-2ba9d8f3c30c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Sep 13 14:21:54.497181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 730/1526] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:54.840868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:54.842986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:54.849763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:54.850239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:54.850665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:54.851344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:54.851790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:54.852208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:54.881080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fcbddd01-7344-4f44-a40b-973ed0f31610 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044181 Sep 13 14:21:54.881618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 797/1527] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:55.268849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:55.271568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:55.277481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:55.277992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:55.278427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:55.279115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:55.279581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:55.279983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:55.308678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43cbfdeb-feb0-4533-b0fe-9afdf9a7de39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Sep 13 14:21:55.309230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 731/1528] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:55.508483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:55.510821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:55.516972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:55.517706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:55.518181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:55.518872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:55.519322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:55.519739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:55.551161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-66638610-b0d1-4c79-8e12-971d3f064bbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Sep 13 14:21:55.551707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 798/1529] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:55.892623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:55.894823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:55.901910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:55.902387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:55.902818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:55.903504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:55.903950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:55.904369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:55.934086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d21a21c5-a94c-4d61-983a-7fecff8c7ce3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045596 Sep 13 14:21:55.934642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 732/1530] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:56.321481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:56.323634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:56.329961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:56.330430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:56.330852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:56.331528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:56.331969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:56.332381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:56.361181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-24acc0a1-14c0-4768-8490-d9dd8b108333 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Sep 13 14:21:56.361749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 799/1531] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:56.565066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:56.567355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:56.573504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:56.574027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:56.574519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:56.575245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:56.575748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:56.576087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:56.606520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-574a6bd4-7f03-46a1-8cd1-fc42a271ff71 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047107 Sep 13 14:21:56.607072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 733/1532] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:56.946345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:56.948490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:56.955092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:56.955578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:56.956035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:56.956725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:56.957177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:56.957602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:56.986185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a8d3e17b-7f60-496b-8dad-ed4640037385 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043865 Sep 13 14:21:56.986731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 800/1533] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:57.429308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:57.431447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:57.437901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:57.438372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:57.438798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:57.439482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:57.439925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:57.440341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:57.468982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ec7baf4-51e8-400e-aa2d-8842888d515b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044327 Sep 13 14:21:57.469532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 734/1534] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:57.620981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:57.623211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:57.629231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:57.629717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:57.630292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:57.631306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:57.631772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:57.632198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:57.662975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c8a75a3f-d7e2-4161-8533-47d77e62ec4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Sep 13 14:21:57.663529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 801/1535] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:57.998502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:58.000791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:58.007305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:58.007775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:58.008201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:58.008879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:58.009323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:58.009751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:58.039639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67b14b6e-e661-4480-9587-a0c8d342ffd8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044991 Sep 13 14:21:58.040203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 735/1536] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:58.480654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:58.482893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:58.488835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:58.489309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:58.490474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:58.491170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:58.491619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:58.492035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:58.520851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f1c8034-377d-44dd-8c0e-ae92a1406e39 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Sep 13 14:21:58.521396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 802/1537] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:58.684883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:58.687149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:58.693520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:58.694035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:58.694465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:58.695155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:58.695601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:58.696024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:58.725455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c213e3d9-7a10-42e6-8f36-f17ff049db20 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044475 Sep 13 14:21:58.726038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 736/1538] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:59.052118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:59.054472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:59.060860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:59.061345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:59.061811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:59.062507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:59.062965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:59.063392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:59.092471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5659d162-924b-485c-96ef-24629d4e3d3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044364 Sep 13 14:21:59.093016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 803/1539] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:21:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:21:59.532579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:59.534823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:59.541021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:59.541495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:59.541970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:59.542655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:59.543106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:59.543533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:59.572706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ec53a6d-1e7d-48a1-be9e-3bef806a98e4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Sep 13 14:21:59.573249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 737/1540] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:21:59.737531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:21:59.740458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:21:59.747183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:59.747763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:59.748199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:59.748906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:21:59.749362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:21:59.749812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:21:59.782284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f2f2d9cc-df59-4809-a20b-d2a2d2746fef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Sep 13 14:21:59.783285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 804/1541] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:21:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:00.104870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:00.107051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:00.113395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:00.113907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:00.114365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:00.115588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:00.116036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:00.116456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:00.144926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0820c2c8-fc51-4c79-a9d7-e06c7b9bb26f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Sep 13 14:22:00.145468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 738/1542] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:00.585154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:00.587309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:00.593654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:00.594187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:00.594622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:00.595305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:00.595756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:00.596175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:00.624864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df2025f4-8902-4f0c-ac9d-89ac825b077e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Sep 13 14:22:00.625409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 805/1543] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:00.794436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:00.796668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:00.802723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:00.803212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:00.803660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:00.804361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:00.804820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:00.805263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:00.809017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:00.840597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f02fbba-8afc-4245-a578-fff089e815b5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050173 Sep 13 14:22:00.841161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 739/1544] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:01.156453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:01.158605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:01.164698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:01.165183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:01.165617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:01.166332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:01.166787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:01.167208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:01.196847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-310cc5f8-ee3a-471e-9195-af22232c35a9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044379 Sep 13 14:22:01.197394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 806/1545] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:01.637292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:01.639466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:01.646113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:01.646585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:01.647012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:01.647689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:01.648134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:01.648547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:01.677532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a231e86d-eacf-447c-b454-0fccecd036c6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Sep 13 14:22:01.678220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 740/1546] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:01.852875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:01.855028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:01.861356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:01.861865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:01.862295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:01.863086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:01.863415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:01.863829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:01.893646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-582b1fe0-4ff4-4992-8c11-284d3d2bec93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Sep 13 14:22:01.894224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 807/1547] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:02.209432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:02.211676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:02.217574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:02.218090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:02.218528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:02.219226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:02.219683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:02.220109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:02.250068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb7dc3a9-3ec7-48c1-af35-437eede17f6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045548 Sep 13 14:22:02.250625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 741/1548] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:02.690312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:02.692558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:02.698786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:02.699278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:02.699718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:02.700416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:02.700877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:02.701336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:02.731888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d82fd7f-3dfd-44f1-ade5-00d6e8f3a8d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045476 Sep 13 14:22:02.732442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 808/1549] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:02.907313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:02.909470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:02.916654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:02.917126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:02.917548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:02.918258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:02.918701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:02.919114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:02.947751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6ec1448-fc63-41df-b166-a33c25db7be1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Sep 13 14:22:02.948303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 742/1550] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:03.262296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:03.264413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:03.271527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:03.272094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:03.272534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:03.273222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:03.273674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:03.274122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:03.302333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5e1aaa4-63d6-4aa9-9ea2-206f59fc624b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Sep 13 14:22:03.302875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 809/1551] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:03.744511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:03.746677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:03.752769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:03.753245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:03.753670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:03.754399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:03.754854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:03.755895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:03.784752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b085a780-f948-4428-af0f-4fcf539ff875 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044068 Sep 13 14:22:03.785239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 743/1552] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:03.959927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:03.962270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:03.968173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:03.968661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:03.969237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:03.969809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:03.970268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:03.970725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:04.001524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ba4ae37f-9d48-4073-9e4d-f299c001fd51 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Sep 13 14:22:04.002116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 810/1553] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:04.314191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:04.316419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:04.323019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:04.323489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:04.323914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:04.324604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:04.325038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:04.325454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:04.355072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24059bd1-4b99-40e7-ac10-75961d84c233 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045112 Sep 13 14:22:04.355626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 744/1554] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:04.796680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:04.798856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:04.805306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:04.805806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:04.806237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:04.806913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:04.807359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:04.807785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:04.836822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4acf6758-fa6d-4de8-b852-371cf24935b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Sep 13 14:22:04.837352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 811/1555] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:05.014412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:05.016585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:05.022808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:05.023292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:05.023726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:05.024487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:05.024975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:05.025399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:05.055452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d7f6fa6-7033-4656-81be-249bc7214cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046379 Sep 13 14:22:05.056210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 745/1556] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:05.368733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:05.371091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:05.373177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:05.378716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:05.379196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:05.379650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:05.380810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:05.381255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:05.381672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:05.406947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:05.412743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e90cd2d6-052f-4992-8591-4cb67930050b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049241 Sep 13 14:22:05.413405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 812/1557] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:05.849982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:05.852100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:05.858580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:05.859054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:05.859483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:05.860165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:05.860613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:05.861032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:05.889364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3f970a2-88f9-45b2-8413-8d630297d7f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Sep 13 14:22:05.889932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 746/1558] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:06.068348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:06.070871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:06.077802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:06.078357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:06.078928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:06.079747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:06.080280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:06.080773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:06.111542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a6a30adf-bfb7-4f82-bc02-cc42fb7dc0a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048014 Sep 13 14:22:06.112087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 813/1559] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:06.424484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:06.426885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:06.433022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:06.433505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:06.433984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:06.434674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:06.435124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:06.435547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:06.465844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94c18384-4c6f-4a89-a98d-a282ce14ff25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045289 Sep 13 14:22:06.466435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 747/1560] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:06.902128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:06.904248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:06.910181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:06.910663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:06.911667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:06.912352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:06.912803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:06.913224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:06.941658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f7a59a5-12ca-4970-a128-a0a52cd3f484 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Sep 13 14:22:06.942387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 814/1561] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:07.123989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:07.126329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:07.132802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:07.133364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:07.133688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:07.134401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:07.134844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:07.135257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:07.165440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d75f05aa-0d2e-4c6f-bb7c-92dda02d9e75 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Sep 13 14:22:07.166144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 748/1562] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:07.479067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:07.481415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:07.487929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:07.488413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:07.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:07.489582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:07.490064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:07.490485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:07.519705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0faedbc5-e933-4e11-80b7-fb15b7e5a119 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044546 Sep 13 14:22:07.520256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 815/1563] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:07.954087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:07.956212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:07.962845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:07.963318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:07.963749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:07.964430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:07.964880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:07.965296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:07.993714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6669c596-b323-46df-83bb-27452ebc7f98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 Sep 13 14:22:07.994354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 749/1564] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:08.178433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:08.180675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:08.188743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:08.189801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:08.190591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:08.191806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:08.193163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:08.193877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:08.223947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46b41290-aca9-4a7b-b0e6-ec09e031cd4b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 Sep 13 14:22:08.224826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 816/1565] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:08.536672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:08.539056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:08.545412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:08.545974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:08.546351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:08.547036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:08.547491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:08.547897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:08.577454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74770940-6268-4ad7-93fd-27b714b281b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044812 Sep 13 14:22:08.578034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 750/1566] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:09.006868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:09.009013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:09.015560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:09.016039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:09.016471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:09.017478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:09.017962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:09.018382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:09.047726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7836470b-4cb4-4b0e-96fd-3734b4899f27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Sep 13 14:22:09.048285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 817/1567] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:09.236189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:09.238373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:09.244803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:09.245281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:09.245848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:09.246408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:09.246852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:09.247268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:09.276654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6e9fd0f-bb05-4908-b2f9-4300f5243ef0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Sep 13 14:22:09.277218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 751/1568] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:09.602363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:09.604476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:09.610374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:09.610857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:09.611291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:09.612012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:09.612467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:09.612918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:09.641874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0134056-f723-4f65-a270-40a05e9fdbb4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044189 Sep 13 14:22:09.642672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 818/1569] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:10.060531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:10.062743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:10.065138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:10.070830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:10.071312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:10.071744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:10.072439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:10.072892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:10.073317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:10.102302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0140b81-39c5-4b8b-90e6-cfc464b3470f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045769 Sep 13 14:22:10.102857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 752/1570] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:10.289100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:10.291309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:10.297826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:10.298299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:10.298726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:10.299413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:10.299873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:10.300518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:10.333621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f76c62f6-2a8d-455d-a0d3-1d0e7e9f529e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048491 Sep 13 14:22:10.334210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 819/1571] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:10.654953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:10.657165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:10.663568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:10.664055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:10.664492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:10.665185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:10.665638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:10.666097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:10.696027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-536ef719-4fb9-4eab-874f-74645a3d6c07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045085 Sep 13 14:22:10.696576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 753/1572] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:11.115153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:11.117267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:11.123187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:11.123662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:11.124088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:11.124756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:11.125201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:11.125616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:11.154228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f82e7b6f-200e-4cca-9ded-1882f1253bfd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Sep 13 14:22:11.154763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 820/1573] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:11.345868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:11.348000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:11.355059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:11.355545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:11.355982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:11.356679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:11.357124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:11.357551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:11.388103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-242f82f9-bc07-4211-8af3-1914435656ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Sep 13 14:22:11.389040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 754/1574] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:11.708249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:11.710417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:11.717035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:11.717525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:11.717988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:11.718758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:11.719154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:11.719580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:11.749871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3e9992b6-6b6b-40ec-a231-c3af781908a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045449 Sep 13 14:22:11.750433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 821/1575] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:12.167005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:12.169138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:12.175108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:12.175585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:12.176015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:12.177420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:12.177921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:12.178345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:12.202400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:12.207861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ecff809f-50e5-4b1a-9d78-15250d99e429 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Sep 13 14:22:12.208378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 755/1576] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:12.400982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:12.403303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:12.409181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:12.409658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:12.410113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:12.410792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:12.411249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:12.411663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:12.452068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b3fa430d-7276-4c19-8161-c75f3cfd6baf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054913 Sep 13 14:22:12.452651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 822/1577] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:12.770688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:12.770688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:12.771366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:12.771848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:12.772449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:12.773374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:12.773857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:12.774375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:12.803870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1c93d37-dd7e-4aac-b5d0-ab435afc6b5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045547 Sep 13 14:22:12.804417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 756/1578] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:13.220329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:13.222522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:13.229600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:13.230107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:13.230537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:13.231213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:13.231660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:13.232073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:13.259810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b61c2ec-fcb2-44ca-b90c-cddcbaa28eb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Sep 13 14:22:13.260348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 823/1579] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:13.465777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:13.468076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:13.474672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:13.475152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:13.475578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:13.476260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:13.476705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:13.478855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:13.513136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36b2b677-9418-4df1-8b25-778a4c3d6225 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051954 Sep 13 14:22:13.513713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 757/1580] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:13.816134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:13.819005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:13.825294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:13.825801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:13.826245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:13.827051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:13.827495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:13.827897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:13.857855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f2fd12b6-396c-40f0-9814-a43124561c6f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045547 Sep 13 14:22:13.858396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 824/1581] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:14.272369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:14.274524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:14.280878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:14.281347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:14.281789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:14.282468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:14.282909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:14.283321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:14.311820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e67fc4a-e489-4b7d-8ad1-70a941416956 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Sep 13 14:22:14.312363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 758/1582] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:14.525099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:14.527375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:14.533989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:14.534472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:14.534907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:14.535602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:14.536596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:14.537080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:14.568721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-442285d9-3ec4-4076-b774-85d71b185220 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047609 Sep 13 14:22:14.573638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 825/1583] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:14.869125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:14.871310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:14.877583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:14.878243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:14.878678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:14.879362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:14.879817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:14.880249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:14.910283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5ebcdba-4ba1-4718-8d50-5b304960b431 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045021 Sep 13 14:22:14.910867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 759/1584] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:15.324307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:15.326614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:15.332573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:15.333816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:15.334255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:15.334945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:15.335425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:15.335846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:15.363851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-778f146d-d191-4a1d-90c9-0ca9401d7e4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Sep 13 14:22:15.364401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 826/1585] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:15.580489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:15.582639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:15.589141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:15.589388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:15.589868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:15.590565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:15.591020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:15.591442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:15.634412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30e02446-e628-4424-b7a4-c8c7e46fd35c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057937 Sep 13 14:22:15.634976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 760/1586] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:15.923252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:15.925369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:15.932348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:15.932877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:15.933472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:15.934163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:15.934625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:15.935144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:15.964807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6bc460bc-50b6-4608-bb32-410724327da6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045523 Sep 13 14:22:15.965354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 827/1587] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:16.375834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:16.378068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:16.384245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:16.384748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:16.385173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:16.385878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:16.386504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:16.387000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:16.416289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7f9febc-722e-4144-8860-90613cc3fb2d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Sep 13 14:22:16.416824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 761/1588] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:16.647640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:16.649873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:16.655688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:16.656169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:16.656601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:16.657287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:16.657761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:16.658188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:16.688133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-696a5879-6b3f-4371-9646-7cc5c9b9445d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044975 Sep 13 14:22:16.688694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 828/1589] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:17.082037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:17.084303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:17.090072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:17.090548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:17.090973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:17.091644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:17.092087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:17.092501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:17.121403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-85e30448-e9c8-43f1-91b1-ecf71cb715a6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148999 Sep 13 14:22:17.121979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 762/1590] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:17.428650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:17.430860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:17.437546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:17.438055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:17.438485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:17.439256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:17.439715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:17.440136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:17.458990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:17.472742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6deb2a14-622a-42d6-a967-df6365b211c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048108 Sep 13 14:22:17.473406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 829/1591] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:17.701359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:17.704092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:17.710774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:17.711277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:17.711704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:17.712387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:17.712831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:17.713244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:17.743523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fe8d9c9-b8d8-46e3-a2bb-81926830fff6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 Sep 13 14:22:17.744090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 763/1592] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:18.083081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:18.083623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:18.089399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.089916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.090351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.091091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.091552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.091975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.130233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:18.132453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:18.138888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.139371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.139805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.140498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.140957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.141377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.171498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-300e0f8f-93a9-493e-96a9-b54596ecb8f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Sep 13 14:22:18.172061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 764/1593] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:18.174069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lazy-loading 'services' on Instance uuid 1a4a1cd1-4081-43bb-ab56-1944c8161e09 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:22:18.177238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:18.179363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:18.184929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.185409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.185880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.186571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.187021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.187440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.217012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd0e7b6d-49d1-403c-bf02-2d6966c393a3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043918 Sep 13 14:22:18.217580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 765/1594] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:18.249942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR oslo.messaging._drivers.impl_rabbit [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [7555cbba-0789-4bbd-9a8a-7579c0cb8c48] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 14:22:18.484491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:18.486742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:18.492745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.493226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.493656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.494371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.494819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.495242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.524670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c1ff64ca-7cc1-4d83-b753-9821dc7841c0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Sep 13 14:22:18.525232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 766/1595] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:18.756088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:18.758246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:18.764520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.765191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.765438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.766150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:18.766597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:18.767280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:18.798435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6501b556-e394-4ad2-b2fd-65be01a066fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Sep 13 14:22:18.799007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 767/1596] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:19.184180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:19.186253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:19.193101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.193572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.194029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.194709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.195155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.195570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.224926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3483930-d371-4632-83d0-0ad6938e7ce3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Sep 13 14:22:19.225478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 768/1597] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:19.229979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:19.232070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:19.237497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.237994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.238416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.239581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.240020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.240433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.258828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [7555cbba-0789-4bbd-9a8a-7579c0cb8c48] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 37884. Sep 13 14:22:19.262286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-94a324d1-49b1-4d81-b1b0-9730082fe52a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09/os-volume_attachments/d5f02a25-caeb-47c6-9246-859ffb754ea9" status: 202 len: 0 microversion: 2.1 time: 1.183204 Sep 13 14:22:19.262873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 830/1598] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 13 14:22:18 2022] DELETE /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09/os-volume_attachments/d5f02a25-caeb-47c6-9246-859ffb754ea9 => generated 0 bytes in 1184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:22:19.270877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39641030-9311-451b-8378-909afe0e77f5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044230 Sep 13 14:22:19.271518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 769/1599] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:19.537499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:19.539721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:19.545975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.546445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.546870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.547549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.547995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.548411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.577215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca718d1f-4ac4-46c9-bb0e-b0971692d73e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Sep 13 14:22:19.577817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 831/1600] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:19.810899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:19.813065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:19.819194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.819675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.820105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.820796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:19.821248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:19.821668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:19.852076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da79d427-27d1-487c-a798-3c951e938d82 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045046 Sep 13 14:22:19.852815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 770/1601] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:20.237367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:20.239911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:20.246476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.246962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.247398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.248093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.248548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.248974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.280902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b8a9e954-1314-4ff7-9397-66cadf8349da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047380 Sep 13 14:22:20.281514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 832/1602] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:20.283394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:20.285511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:20.292681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.293157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.293583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.294295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.294739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.295155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.324157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c89131b-e3cb-47c0-bafb-676fb61fd37f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044861 Sep 13 14:22:20.324700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 771/1603] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:20.589837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:20.591974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:20.594146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:22:20.594282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:22:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:22:20.601188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.601675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.602130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.602818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.603271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.603693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.633938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-181d4643-a5c6-4cb8-939e-7eea3f9f9138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047999 Sep 13 14:22:20.634491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 833/1604] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:20.864685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:20.866949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:20.872807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.873282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.873716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.874425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:20.874880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:20.875298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:20.892604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:20.916979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f047c54-59d3-4fe9-81ba-ccd90ce28212 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056647 Sep 13 14:22:20.917557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 772/1605] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:21.293403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:21.295563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:21.302358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.302942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.303374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.304066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.304518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.304942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.333566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0b181562-00f6-4fc6-9858-290f03a2e291 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044103 Sep 13 14:22:21.334158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 834/1606] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:21.336868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:21.341001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:21.352465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.352943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.353431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.354200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.354647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.355065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.385269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9300098a-24af-44e8-9884-5802f6478767 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052496 Sep 13 14:22:21.385874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 773/1607] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:21.646943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:21.649015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:21.655390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.655866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.656294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.656979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.657432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.657882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.686333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e0ed806-4cd5-460c-8962-3bf4f8697432 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043641 Sep 13 14:22:21.686906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 835/1608] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:21.929884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:21.932031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:21.938225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.939059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.939828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.941007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:21.941882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:21.942622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:21.972235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b112095-a98a-4a27-a835-f2212531cf49 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047024 Sep 13 14:22:21.973512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 774/1609] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:22.345987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:22.348726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:22.354874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.355356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.355792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.356491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.356947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.357370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.387115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-61a7db69-d4a8-458e-9a6c-1eb339375d38 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 Sep 13 14:22:22.387673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 836/1610] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:22.398144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:22.400318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:22.406901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.407380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.407811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.408501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.408951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.409424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.438756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1821b959-bb84-4a63-897f-27ea3bf7ca4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045073 Sep 13 14:22:22.439300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 775/1611] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:22.698249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:22.700403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:22.706823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.707297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.708472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.709151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.709598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.710038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.738012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56e0a7f7-df94-41a6-b180-0b808065efa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043636 Sep 13 14:22:22.738552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 837/1612] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:22.985419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:22.987593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:22.994017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.994499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.994932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:22.995623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:22.996070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:22.996494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.026677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46eca3bf-bc09-41ea-9ee7-0860d4de219d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Sep 13 14:22:23.031322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 776/1613] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:23.399650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:23.401720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:23.407707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:23.408184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:23.408610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.409290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:23.409748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:23.410176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.439979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69dd9e06-dc42-40ac-8731-ff5f1252cd97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Sep 13 14:22:23.440521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 838/1614] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:23.450984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:23.453106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:23.459050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:23.459526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:23.459957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.460644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:23.461097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:23.461519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.491881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d65ba4ac-e240-464b-acde-c3dc41e15371 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045007 Sep 13 14:22:23.492456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 777/1615] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:23.750539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:23.752726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:23.759376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:23.759892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:23.760299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.760983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:23.761430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:23.761879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:23.791925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c1d952e2-8cb8-4203-b938-a2e8337323f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Sep 13 14:22:23.792479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 839/1616] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:24.039429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:24.042134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:24.049566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.050071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.050612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.051236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.051939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.052476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.086828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32e98c17-b787-4428-a325-39f35453f74a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052626 Sep 13 14:22:24.087535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 778/1617] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:24.505381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:24.507556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:24.514452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.514926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.515353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.516042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.516487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.517161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.517880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:24.520692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:24.529816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.530372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.530877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.531654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.532336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.532772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.550622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fae5d091-24ac-494d-bec1-025fc7c6d77e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049954 Sep 13 14:22:24.551708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 779/1618] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:24.563778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a8216b7f-d071-428e-aed3-6994e94aa2df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115174 Sep 13 14:22:24.565902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 840/1619] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:24.804156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:24.806326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:24.812279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.812760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.813193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.813927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:24.814374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:24.814793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:24.845997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-985b606f-13c4-4d28-bcb2-bafedb19c150 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Sep 13 14:22:24.846552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 780/1620] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:25.100191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:25.102442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:25.109096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.109582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.110060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.110756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.111212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.111632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.146211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7955e4fc-a9f6-47a9-9908-11296c2ab818 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050640 Sep 13 14:22:25.147533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 841/1621] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:25.563856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:25.566081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:25.573079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.573548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.574004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.574693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.575136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.575565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.576456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:25.578574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:25.584606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.585203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.585640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.586357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.586805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.587226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.606334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c378fac-2d12-492e-b2ab-b3faea30ec9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046466 Sep 13 14:22:25.606907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 781/1622] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:25.618220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47886030-8142-49ab-bd37-bd169e49273d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Sep 13 14:22:25.618769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 842/1623] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:25.859032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:25.861114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:25.867687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.868161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.868593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.869279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:25.869751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:25.870172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:25.898282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17266921-c0f8-454e-8d7b-5c2cb6984a99 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Sep 13 14:22:25.898831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 782/1624] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:26.159167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:26.161829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:26.168163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.168641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.169070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.171624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.171624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.171624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.201098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db041f60-c11f-4c91-a8a1-c83a576fa2af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045902 Sep 13 14:22:26.201673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 843/1625] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:26.618949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:26.621124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:26.627868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.628347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.628785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.630544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.631108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:26.631558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.631660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.633206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:26.639076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.639550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.639977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.640671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.641119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.641535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.662884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b8e3c87-cd89-4eda-bd2a-464200518a3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047893 Sep 13 14:22:26.663463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 783/1626] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:26.671249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-660cf6d9-2244-47eb-811c-f83919fa5b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Sep 13 14:22:26.671785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 844/1627] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:26.911134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:26.913272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:26.919147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.919619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.920045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.920721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:26.921165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:26.921589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:26.950535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d697637-8957-4e6e-937a-f3b9049f5300 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Sep 13 14:22:26.951079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 784/1628] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:27.215861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:27.218070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:27.225034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.225548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.226017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.226708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.227168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.227588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.244600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:27.259005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4eedd17b-6562-4344-8e54-70e154f9e1eb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047109 Sep 13 14:22:27.259559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 845/1629] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:27.675450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:27.677637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:27.683578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:27.684046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.684498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.684921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.685604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.685706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:27.686080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.686502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.691510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.691997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.692426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.693102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.693547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.693990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.715920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8407ed7-ae1b-4225-8129-3b1c3fb06193 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044394 Sep 13 14:22:27.716482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 785/1630] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:27.724098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ce6a43c-11a7-4684-aba0-cf1dc77f822b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Sep 13 14:22:27.724644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 846/1631] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:27.962912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:27.965023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:27.970912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.971376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.971797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:27.972471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:27.972910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:27.973447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.001267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d8b66a9-43f8-4c9c-8381-983c8ccb942c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042377 Sep 13 14:22:28.001826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 786/1632] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:28.271920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:28.274052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:28.280494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:28.280981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:28.281418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.282274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:28.282736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:28.283164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.312350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fc7fea5e-d23e-47b4-ac03-1c88ae2640bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Sep 13 14:22:28.312895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 847/1633] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:28.729197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:28.731365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:28.735593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:28.737768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:28.737886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:28.738339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:28.739501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.740576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:28.741037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:28.741467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.744549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:28.745033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:28.745467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.746197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:28.746652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:28.747076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:28.772182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-df0b6ba2-2eae-4350-a9ce-2310944b652d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046989 Sep 13 14:22:28.772754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 787/1634] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:28.776637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ca55d72-9ec6-4856-98d3-8d49873dd1c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Sep 13 14:22:28.777188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 848/1635] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:29.014175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:29.016430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:29.023177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.023653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.024087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.024775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.025253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.025671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.054787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8420a612-81d3-45e5-a56b-1ff6a82ceadb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044470 Sep 13 14:22:29.055269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 788/1636] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:29.325314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:29.327465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:29.334574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.335058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.335494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.336191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.336651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.337078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.366143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-afa0bd2f-6c48-4fd5-a62e-297f1f89fdd2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Sep 13 14:22:29.366694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 849/1637] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:29.784967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:29.787237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:29.789050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:29.791187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:29.793679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.794195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.794631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.795329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.795782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.796210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.797034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.797511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.797972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.798656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:29.799105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:29.799527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:29.799896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:29.827366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2761ae82-d769-4cb8-b430-cfa8e686cad0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046582 Sep 13 14:22:29.827939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 789/1638] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:29.830791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0e6493f7-fcb8-4da1-83d7-9cb7edb15aa3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Sep 13 14:22:29.831507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 850/1639] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:30.068168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:30.070888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:30.076837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.077316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.077779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.078473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.078928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.079354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.120682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74033f1a-b8cb-48e2-9c6f-8c427c937a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057316 Sep 13 14:22:30.121234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 790/1640] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:30.378744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:30.381050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:30.387578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.388058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.388496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.389180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.389634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.390091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.421815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a1b66ec0-59e6-4e14-8edc-73708d313d52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046982 Sep 13 14:22:30.422404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 851/1641] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:30.840845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:30.843067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:30.843932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:30.846757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:30.850661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.851202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.851640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.852338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.852969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.853395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.854011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.854395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.854844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.855577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:30.856037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:30.856463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:30.887570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3ab68a1-8f8f-4502-af68-8d0208223f42 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051623 Sep 13 14:22:30.888431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 791/1642] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:30.890864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5a7a0aca-ced1-416d-a4b1-a53f16877896 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051603 Sep 13 14:22:30.891416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 852/1643] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:31.132568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:31.134764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:31.141078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.141561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.142280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.142972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.143419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.143843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.178875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b51e8ca-90fd-445f-9ac9-61899328338e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050315 Sep 13 14:22:31.179437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 792/1644] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:31.436754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:31.439257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:31.447451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.448026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.448529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.449307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.450000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.450491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.482381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-85869bf8-cb07-4ddc-a6d6-105f8774b50b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051725 Sep 13 14:22:31.482953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 853/1645] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:31.901031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:31.903345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:31.904675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:31.906966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:31.909981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.910480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.911315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.912247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.912779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.913320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.913606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.914187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.914710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.915497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:31.916058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:31.916608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:31.947053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7014efc0-c557-478a-bef6-ccdb1a26088f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050112 Sep 13 14:22:31.947823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 793/1646] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:31.948564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-585a2dab-4116-4070-99cf-8ffc6a04a385 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047708 Sep 13 14:22:31.949269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 854/1647] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:32.191841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:32.194064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:32.200703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.201187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.201615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.202489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.202938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.203359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.237035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-837e0239-9e3d-4cd6-bf0e-12a73925840f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049235 Sep 13 14:22:32.237855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 794/1648] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:32.494922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:32.497042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:32.503731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.504218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.504651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.505341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.505906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.506361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.536058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-489b0e07-1b49-4149-97be-928f9eae456c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044537 Sep 13 14:22:32.536760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 855/1649] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:32.959696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:32.960867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:32.961843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:32.963010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:32.968805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.968968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.969283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.969395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.969709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.969854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.970414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.970548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:32.970863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.970999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:32.971282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:32.971481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:33.002166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd28986b-1ced-41b6-8f50-1874efdef978 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046948 Sep 13 14:22:33.002398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-004ffcd4-91ad-43e3-81ea-7c0992bbed70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Sep 13 14:22:33.002910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 795/1650] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:33.003028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 856/1651] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:33.250454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:33.252497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:33.258892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:33.259365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:33.259788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:33.260474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:33.260919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:33.261333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:33.290072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfce0b6a-91a4-4f39-8a35-554e1beebe3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Sep 13 14:22:33.290604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 796/1652] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:33.548539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:33.550741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:33.557669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:33.558178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:33.558608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:33.559364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:33.559817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:33.560241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:33.589663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1319889a-0c26-470c-8f25-caa9dce9d223 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Sep 13 14:22:33.590231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 857/1653] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:34.014120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:34.014749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:34.016296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:34.017083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:34.023005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.023162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.023480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.023619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.023901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.024033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.024584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.024700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.025033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.025162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.025449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.025550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.056291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42e1edf9-3d02-4d95-9b01-5b626c480da4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045416 Sep 13 14:22:34.056852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 858/1654] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:34.056987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25534e41-e1e6-4295-bff8-f0bb908f66ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046769 Sep 13 14:22:34.057511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 797/1655] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:34.302576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:34.304634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:34.310602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.311081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.311507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.312197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.312645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.313063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.341497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1f496c4e-cfb5-451e-9cda-bf5fc0131f61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Sep 13 14:22:34.342158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 859/1656] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:34.861882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:34.864196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:34.870049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.870522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.870983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.871697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:34.872150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:34.872570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:34.902218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1bdeb8ee-beef-423b-ae0c-bf29afe99892 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.304530 Sep 13 14:22:34.902766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 798/1657] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:35.068547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:35.069819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:35.070712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:35.071927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:35.077167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.077644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.078109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.078214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.078582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.078800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.079123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.079249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.079669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.079815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.080262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.080678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.109121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ceebf653-bf61-4edd-be85-6ccbf992107b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045165 Sep 13 14:22:35.109600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 860/1658] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:35.109776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-676687bd-eb73-4f0c-aa95-9721149a70ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Sep 13 14:22:35.110248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 799/1659] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:35.354650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:35.356851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:35.362829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.363259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.364485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.365405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.365912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.366347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.395131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0c31e76-43d7-454d-abef-7da1f6c9e3d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Sep 13 14:22:35.395866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 861/1660] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:35.915339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:35.917565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:35.923565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.924047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.924483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.925171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:35.925625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:35.926078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:35.954791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ec1185d-bbf9-4923-b2ea-8db76283907e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Sep 13 14:22:35.955338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 800/1661] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:36.122091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:36.122631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:36.124141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:36.124660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:36.126757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:36.131659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.132127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.132286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.132552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.132669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.133086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.133238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.133682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.133803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.134122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.134236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.134649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.138725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:36.164438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e229a4ed-5b33-49fd-af45-df5e2a45f723 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Sep 13 14:22:36.164995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 801/1662] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:36.166454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0c43137-5370-4143-95fc-35b6ba3d1206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048445 Sep 13 14:22:36.167009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 862/1663] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:36.407625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:36.409820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:36.412307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:36.417536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.418032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.418457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.419160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.419607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.420019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.448476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d17cf05b-392b-40f7-8868-b075b1249218 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Sep 13 14:22:36.449025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 802/1664] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:36.967764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:36.969979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:36.976006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.976484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.976913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:36.977598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:36.978080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:36.978515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.007085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d6703fb9-c237-4810-b9fd-2807262b372a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043310 Sep 13 14:22:37.007624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 863/1665] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:37.176737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:37.179243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:37.179642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:37.181334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:37.185976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:37.186449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:37.186875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.187573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:37.187719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:37.188024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:37.188155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:37.188441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.188558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.189191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:37.189664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:37.190091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.218706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bec810dc-e465-493e-8851-d77a3adeb4fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 Sep 13 14:22:37.219342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 803/1666] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:37.219947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9a7e3f3-300c-44c3-a081-4a48dd075170 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045022 Sep 13 14:22:37.220705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 864/1667] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:37.460512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:37.462713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:37.468868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:37.469343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:37.469794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.470482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:37.470930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:37.471349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:37.500116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2606c434-9d00-4af3-8d69-550c04e925f1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Sep 13 14:22:37.500667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 804/1668] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:38.030064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:38.032206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:38.038274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.038757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.039198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.039881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.040333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.040756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.071158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a62295fa-d6ee-4886-81e1-710d25343d22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 13 14:22:38.071707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 865/1669] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:38.231197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:38.232143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:38.233310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:38.234247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:38.240252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.240822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.241297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.241416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.241816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.242263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.242391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.242773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.242955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.243190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.243410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.243837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.270472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:38.274273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1150c753-1427-4363-a5b5-4ee48462077f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045872 Sep 13 14:22:38.274853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 866/1670] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:38.275766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b809c8eb-f813-49ed-b7e6-e244d28f42e8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048565 Sep 13 14:22:38.276321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 805/1671] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:38.512420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:38.514526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:38.520731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.521358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.522126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.522836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:38.523298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:38.523765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:38.554571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9269bccd-dc22-4542-840a-cfc3cc060a44 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Sep 13 14:22:38.555126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 867/1672] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:39.085644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:39.087817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:39.093979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.094458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.094891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.095578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.096029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.096451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.126509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39881f28-b127-4888-9845-3a13d5bc2684 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046682 Sep 13 14:22:39.127064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 806/1673] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:39.287930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:39.289001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:39.290175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:39.291826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:39.296650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.297133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.297560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.298282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.298729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.299144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.299423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.299913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.300342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.302487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.302950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.303378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.330568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c52f754-4b32-45d2-b7d4-81ac13704803 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046957 Sep 13 14:22:39.331139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 868/1674] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:39.341809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d426bb44-cec9-4963-925f-fa2529166aa5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057013 Sep 13 14:22:39.342387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 807/1675] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:39.567259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:39.570819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:39.578341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.579166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.579873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.580589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:39.581049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:39.581478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:39.613709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e2faa3f4-7088-4eab-8d2a-8d24d3729fe7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050546 Sep 13 14:22:39.614294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 869/1676] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:40.139347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:40.141495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:40.147707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.148176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.148599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.149274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.149717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.150160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.179436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcce001a-5ad1-47b7-8f81-07841a6cb4fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043391 Sep 13 14:22:40.179995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 808/1677] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:40.344247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:40.346385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:40.353896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.354384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.354628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:40.355046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.355532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.356014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.356435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.356844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:40.363328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.363803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.364224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.364912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.365355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.365880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.386132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6aa1d896-52bd-436c-b349-2c70dbc0df1b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045996 Sep 13 14:22:40.386697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 870/1678] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:40.395967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf169de9-1190-42e2-a898-bfc67c52f631 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Sep 13 14:22:40.396517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 809/1679] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:40.627118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:40.629228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:40.635729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.636198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.636622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.637297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:40.637759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:40.638175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:40.668598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ebd4514-c48e-4c7b-bb1e-569c1001f2db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Sep 13 14:22:40.669169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 871/1680] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:41.190998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:41.193147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:41.199847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.200329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.200742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.201449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.201924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.202342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.231333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f07030ab-c0b9-4fc2-b76d-8416c8e1d51e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Sep 13 14:22:41.231907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 810/1681] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:41.399069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:41.401137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:41.408598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.408821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:41.409301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.409656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.410536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.410772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:41.411052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.411493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.417703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.418231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.418660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.419336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.419779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.420192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.443293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1c46d951-7caa-4bd5-90fb-52649defa1e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048113 Sep 13 14:22:41.443860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 872/1682] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:22:41.450164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa57841b-e1a5-4f62-a4f3-6c9f0c99c6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Sep 13 14:22:41.450718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 811/1683] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:41.681014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:41.683129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:41.688967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.689441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.689909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.690588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:41.691032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:41.691447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:41.719861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4b53b727-c7e1-4222-bb68-59051bb0ac29 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Sep 13 14:22:41.720396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 873/1684] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:42.244308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:42.246438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:42.252385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.252864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.253297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.254019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.254470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.254894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.284614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95defcae-433f-4a70-8593-6913e0360f9a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Sep 13 14:22:42.285157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 812/1685] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:42.455996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:42.458287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:42.462679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:42.464790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:42.464916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.465398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.465853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.466544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.466990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.467421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.471091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.471564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.471995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.472683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.473133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.473555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.498241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-41e9cfe4-ce9d-4d08-80af-6ab530922250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046164 Sep 13 14:22:42.498725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 874/1686] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:42.503350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7040df75-dc95-4942-a60f-b4b6effd10d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Sep 13 14:22:42.503903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 813/1687] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:42.732956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:42.735141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:42.741973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.742738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.743178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.743869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:42.744466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:42.744895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:42.774383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e83da17a-7626-4d7a-99fa-d96bc020f4a3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Sep 13 14:22:42.774912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 875/1688] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:43.296393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:43.298558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:43.305353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.305856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.306286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.306975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.307426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.307848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.336917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf24b159-9324-4be8-b5c1-0070015aa9ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Sep 13 14:22:43.337464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 814/1689] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:43.510880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:43.513009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:43.516178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:43.518574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:43.519749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.520235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.520671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.521431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.521922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.522377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.525703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.527641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.527984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.528702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.529151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.529589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.553034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d20cdc6-9288-4022-8d02-a544289e4497 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046191 Sep 13 14:22:43.553652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 876/1690] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:43.560305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1c6f1fc-68fd-41ee-92aa-38fe22a72fd2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047909 Sep 13 14:22:43.560858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 815/1691] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:43.787391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:43.790095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:43.795910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.796387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.796829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.797534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:43.798005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:43.798423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:43.827736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-595c51a7-0609-4b7a-8645-2f996bf4c11c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Sep 13 14:22:43.828275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 877/1692] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:44.349698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:44.352423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:44.358716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.359250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.359798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.360512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.360963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.361384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.391674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f2d7e83f-11cf-42cc-a05a-78cdbe8fa990 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Sep 13 14:22:44.392482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 816/1693] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:44.566268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:44.568488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:44.572804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:44.575069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:44.575375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.575865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.576304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.577001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.577460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.577924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.581562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.582075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.582518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.583222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.583679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.584155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.604400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:44.609762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f85720e-a715-4c9f-8a7c-c2e4af8ee8a8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047567 Sep 13 14:22:44.610337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 878/1694] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:44.615197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08614fd1-b442-48e2-b7dd-a36413e6b7dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046338 Sep 13 14:22:44.615741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 817/1695] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:44.840743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:44.842913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:44.849023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.849506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.849989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.851371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:44.851833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:44.852263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:44.881049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc76f6ff-e3d8-47eb-b19e-584c5000d465 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Sep 13 14:22:44.881605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 879/1696] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:45.404375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:45.406575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:45.412490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.412956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.413382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.414086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.414531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.414942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.444167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45708621-d8f1-408a-859a-bfc5aa6ef1bd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Sep 13 14:22:45.444713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 818/1697] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:45.622617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:45.624801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:45.628038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:45.630306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:45.631447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.631907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.632341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.633039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.633505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.633957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.637459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.637981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.638417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.639136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.639587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.640006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.664204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05563732-86b1-4da0-93c4-275addbd5b2f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 Sep 13 14:22:45.664776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 880/1698] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:45.670046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2d6d269-e86f-4391-867e-f4f928626b3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Sep 13 14:22:45.670599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 819/1699] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:45.893911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:45.896057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:45.902205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.902688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.903124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.903808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:45.904260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:45.904683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:45.933903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b5116c8-5d6b-4479-8a35-fba0bca964f4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Sep 13 14:22:45.934441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 881/1700] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:46.457242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:46.459398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:46.466184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.466657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.467082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.467763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.468210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.468622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.500590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1b41862-e0d9-460d-bc08-f3bc5c04dbe3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047332 Sep 13 14:22:46.501151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 820/1701] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:46.677432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:46.679561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:46.682061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:46.684306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:46.685754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.686249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.686677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.687620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.687815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.688236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.690554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.691028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.691450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.692129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.692576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.692987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.718708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a87a6fd3-3560-4152-9bfc-883e88d10fb1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045460 Sep 13 14:22:46.719277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 882/1702] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:46.723264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79e25600-5ef3-4d70-91f2-af49d204362a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Sep 13 14:22:46.723815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 821/1703] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:46.946398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:46.949198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:46.955139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.955619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.956050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.956736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:46.957194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:46.957619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:46.986326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c220358-56df-40a2-a80a-5d26fe15a17b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Sep 13 14:22:46.986875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 883/1704] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:47.513171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:47.515314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:47.521795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:47.522283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:47.522711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:47.523401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:47.523846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:47.524265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:47.541996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:47.555866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fad22cf4-d694-40fe-b632-9a0acd8bd824 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046751 Sep 13 14:22:47.556420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 822/1705] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:47.731794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:47.733979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:47.735163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:47.737277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:47.740474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:47.740993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:47.741425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:47.742152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:47.742605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:47.743029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:47.743625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:47.744166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:47.744588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:47.745273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:47.745745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:47.746218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:47.772608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aefcbd1e-4e2d-4c51-b2d8-bcae5cad693d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045335 Sep 13 14:22:47.773170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 884/1706] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:47.776070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3c0a8a8-e1be-4e5c-91b3-69e03f7ed07f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044683 Sep 13 14:22:47.776629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 823/1707] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:47.999159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:48.001222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:48.007160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.007646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.008084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.008804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.009258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.009683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.040070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a773b020-c438-4414-b8b2-689601144994 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Sep 13 14:22:48.040628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 885/1708] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:48.568390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:48.570546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:48.577274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.577805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.578235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.578916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.579361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.580063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.610402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7dff52a9-8e78-4197-8002-d9da37fcc1a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Sep 13 14:22:48.610965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 824/1709] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:48.785513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:48.787604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:48.788197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:48.790303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:48.794765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.795252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.795686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.796384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.796862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.797246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.797369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.797721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.798180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.798861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:48.799309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:48.799751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:48.827865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-74168628-3931-46e6-8929-9a45019a67e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046336 Sep 13 14:22:48.828443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 886/1710] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:48.829283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4580cae8-a807-46f6-bae8-4bbe86cd04a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Sep 13 14:22:48.829858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 825/1711] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:49.052693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:49.054805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:49.060707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.061218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.061654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.062405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.062858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.063285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.091783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f25539c7-5150-4cf4-8307-aa27b065b545 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Sep 13 14:22:49.092334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 887/1712] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:49.622295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:49.624520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:49.630471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.630949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.631380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.632085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.632524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.632945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.662784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d3e2c36-c628-418e-a559-a712f2f68695 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Sep 13 14:22:49.663335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 826/1713] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:49.840709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:49.841285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:49.842782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:49.843108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:49.849380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.849523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.849987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.850108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.850415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.850531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.851132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.851250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:49.851589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.851689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:49.852015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.852126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:49.881889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-747482b9-f851-4b14-b91c-6ee2ed60c4d4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045460 Sep 13 14:22:49.882112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-580f72d0-4d8c-4a1b-8c62-90ffe78db727 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045580 Sep 13 14:22:49.882729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 827/1714] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:49.882853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 888/1715] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Sep 13 14:22:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:22:50.104148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:50.106294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:50.112148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.112623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.113054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.113761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.114211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.114632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.144085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-504ef142-adc0-4df6-ab43-68262ad9b4db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Sep 13 14:22:50.144629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 828/1716] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:50.675526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:50.677649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:50.684181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.684659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.685114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.685836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.686288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.686709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.715904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df4e4b60-89e9-401b-99ce-d31d13f6945d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044408 Sep 13 14:22:50.716447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 889/1717] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:50.894809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:22:50.895788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:50.896955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:50.898066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:50.903589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.904007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.904437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.904722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.905131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.905278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.905579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.905711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.906026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.906418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:50.906887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:50.907359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:50.932829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [5d9fd44d-763b-427e-8917-b5cbfdee66bd] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 14:22:50.938734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-307cb132-cf08-4d83-b27b-37f42bdc3074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047256 Sep 13 14:22:50.939307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 890/1718] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:51.156896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:51.159025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:51.164859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:51.165332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:51.165780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:51.166462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:51.166909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:51.167931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:51.197182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-86a5fa3b-aee3-4e0c-b54f-192bd4227f49 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Sep 13 14:22:51.197746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 891/1719] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:51.728272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:51.730542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:51.736524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:51.737003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:51.737431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:51.738146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:51.738597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:51.739018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:51.768851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-01751756-52af-4991-bf64-2efabd756261 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Sep 13 14:22:51.769417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 892/1720] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:51.939656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [5d9fd44d-763b-427e-8917-b5cbfdee66bd] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 38360. Sep 13 14:22:51.951500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:51.953634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:51.960017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:51.960495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:51.960926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:51.961616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:51.962107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:51.962527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:51.992004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9f738cea-87bd-48ba-842b-8f528642fe29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Sep 13 14:22:51.992550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 893/1721] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:52.015888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f3b86b3-d1ec-486e-9e5b-1749cff7939e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/action" status: 200 len: 37445 microversion: 2.20 time: 1.125259 Sep 13 14:22:52.016558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 829/1722] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Sep 13 14:22:50 2022] POST /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b/action => generated 37445 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 13 14:22:52.209475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:52.211653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:52.217643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:52.218160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:52.218594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:52.219282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:52.219734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:52.220161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:52.248836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6e087f1e-5123-4c86-bb52-034f97cb5aa9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Sep 13 14:22:52.249377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 894/1723] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:52.782161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:52.784315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:52.791296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:52.791766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:52.792188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:52.793420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:52.794033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:52.794452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:52.824580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a117129a-6972-493f-bcb4-dca3cd415f55 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046750 Sep 13 14:22:52.825116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 830/1724] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:53.004545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:53.006773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:53.015525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:53.016012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:53.016456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:53.017419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:53.017914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:53.018344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:53.034644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:53.048090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ebc3903-d940-494d-8630-f71f02c5406d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Sep 13 14:22:53.048644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 895/1725] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:53.261101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:53.263401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:53.270494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:53.270961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:53.271385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:53.272062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:53.272508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:53.272956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:53.301655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d55f1d3-7528-4548-8703-3baa7e2ab4d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Sep 13 14:22:53.302153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 831/1726] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:53.836590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:53.838854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:53.845440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:53.845955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:53.846389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:53.847074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:53.847527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:53.847950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:53.877161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9afaeba5-4a31-4c71-90ee-7e971891d770 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Sep 13 14:22:53.877705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 896/1727] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:22:54.060184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:54.062279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:54.069262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:54.069769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:54.070269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:54.071029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:54.071540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:54.071965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:54.102700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a5808c2-999e-4a74-aa96-92d9b9b22365 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Sep 13 14:22:54.103255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 832/1728] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:54.314974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:54.318024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:54.328406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:54.328890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:54.329325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:54.330193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:54.330649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:54.331073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:54.360490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-49902ee4-3eff-44bb-a29d-70796f8aaccb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049515 Sep 13 14:22:54.361050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 897/1729] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:54.889231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:54.891363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:54.897973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:54.898447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:54.898876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:54.899553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:54.899996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:54.900405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:54.929435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d245ab10-bc59-41d2-8c6e-271fc286d534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Sep 13 14:22:54.930000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 833/1730] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:55.115272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:55.117312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:55.123685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:55.124162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:55.124592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:55.125282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:55.125752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:55.126184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:55.157564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-47b2a407-40a2-4c8b-9dd1-f48040032df1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Sep 13 14:22:55.158367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 898/1731] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:55.372348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:55.374439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:55.380670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:55.381137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:55.381559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:55.382263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:55.382715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:55.383131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:55.413278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e8a2c95-dd57-4f44-8c64-b9e3f3c257c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Sep 13 14:22:55.413893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 834/1732] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:55.942685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:55.944953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:55.952580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:55.953063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:55.953498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:55.954216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:55.954671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:55.955094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:55.984454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-238b1e0e-e654-4320-96b9-2f43e91c7123 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Sep 13 14:22:55.985006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 899/1733] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:56.170803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:56.172903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:56.179326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:56.179801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:56.180231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:56.180916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:56.181366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:56.181812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:56.210777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8cd0c84e-99f4-4967-9eaf-8db99267b8a1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Sep 13 14:22:56.211324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 835/1734] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:56.425747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:56.427856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:56.434431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:56.434912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:56.435350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:56.436043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:56.436502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:56.436927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:56.465770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f4dbcd1d-5f4f-4417-bb4a-ef500b859c46 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Sep 13 14:22:56.466435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 900/1735] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:56.996841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:56.999000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:57.004917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:57.005389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:57.005848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:57.006536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:57.006985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:57.007406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:57.039314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3bfd782-b956-4073-8108-4f4356beaec5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Sep 13 14:22:57.040066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 836/1736] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:57.223665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:57.225832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:57.232332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:57.232835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:57.233272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:57.233985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:57.234444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:57.234866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:57.265060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9db40e26-6d1f-42e2-ae7d-603710df6562 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Sep 13 14:22:57.265660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 901/1737] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:57.477811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:57.479946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:57.486504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:57.486980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:57.487408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:57.488094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:57.488544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:57.488965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:57.518692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-496920b2-e2e3-4d33-a597-c0aaf0ee7ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Sep 13 14:22:57.519246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 837/1738] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:58.051856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:58.054067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:58.060067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:58.060535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:58.060958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:58.061633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:58.062128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:58.062546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:58.092072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e5ede911-690c-4dee-bb31-adcee4abfcad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044112 Sep 13 14:22:58.092621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 902/1739] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:58.278780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:58.280832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:58.286847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:58.287324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:58.287759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:58.288441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:58.288889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:58.289314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:58.319057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4c3811f-7765-4512-b1a8-8cf44facbdd3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045055 Sep 13 14:22:58.319608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 838/1740] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:58.531321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:58.534150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:58.540625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:58.541099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:58.541529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:58.542245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:58.543210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:58.543782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:58.572881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1364144a-fd5c-4e76-8d06-c1ba5fe6ec23 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Sep 13 14:22:58.573420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 903/1741] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:59.104343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:59.107172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:59.113527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:59.114044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:59.114477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:59.115159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:59.115608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:59.116029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:59.132346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:22:59.146587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30d4e92c-9988-4d4e-80d2-843972f7c384 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Sep 13 14:22:59.147139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 839/1742] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:59.332204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:59.334389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:59.340374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:59.341819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:59.342278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:59.342963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:59.343450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:59.343877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:59.373318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-efa33dc3-5802-439d-8654-fca188b3ca74 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Sep 13 14:22:59.373894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 904/1743] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:22:59.584531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:22:59.586623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:22:59.592692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:59.593161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:59.593623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:59.594330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:22:59.594771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:22:59.595189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:22:59.625275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cf45207-6b71-4cd8-b204-1e8461355647 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Sep 13 14:22:59.625855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 840/1744] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:22:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:00.159223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:00.161380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:00.167780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:00.168259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:00.169187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:00.169930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:00.170431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:00.170858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:00.199904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3eeac32c-8680-455e-bc0b-ae0a30db74ec tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Sep 13 14:23:00.200453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 905/1745] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:00.385755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:00.387967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:00.394815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:00.395296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:00.395732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:00.396425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:00.396878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:00.397298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:00.427293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cf6118f-82a5-4934-b52d-4ef0268c5407 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045577 Sep 13 14:23:00.427844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 841/1746] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:00.638747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:00.640828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:00.646964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:00.647446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:00.647877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:00.648569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:00.649021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:00.649439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:00.680121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-362432bf-03af-417e-9b4f-0c1c9f5c1d17 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046119 Sep 13 14:23:00.680710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 906/1747] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:01.212211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:01.214435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:01.220496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:01.220968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:01.221399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:01.222111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:01.222562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:01.222982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:01.251775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58cbf24f-01c5-4026-9462-f16d602dca24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Sep 13 14:23:01.252321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 842/1748] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:01.439939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:01.442010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:01.448462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:01.448943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:01.449376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:01.450195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:01.450645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:01.451077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:01.479447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-45fb5335-8c51-4133-a3d7-f439ce615777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Sep 13 14:23:01.479987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 907/1749] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:01.692494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:01.694621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:01.701235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:01.701712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:01.702171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:01.702858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:01.703308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:01.703728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:01.733065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42a5077d-4f8f-41cb-b805-3eb072079e91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Sep 13 14:23:01.733606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 843/1750] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:02.264170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:02.266355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:02.272602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:02.273094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:02.273527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:02.274241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:02.274700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:02.275127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:02.305420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ba1404e8-4570-43d0-996c-6285396505e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046085 Sep 13 14:23:02.306010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 908/1751] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:02.492524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:02.494588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:02.500620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:02.501091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:02.501517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:02.502238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:02.502684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:02.503099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:02.533099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-788ac84d-30b2-478e-a9fb-7810e0bfa78b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Sep 13 14:23:02.533661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 844/1752] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:02.744489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:02.746584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:02.752853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:02.753333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:02.753790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:02.754480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:02.754932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:02.755359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:02.784051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2f5bfe19-5859-46b5-8194-a992552e90c1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Sep 13 14:23:02.784589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 909/1753] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:03.318491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:03.320659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:03.327707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:03.328187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:03.328623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:03.329314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:03.329786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:03.330214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:03.359063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ba05cb7-e2b5-4d2d-8932-9d3590505079 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Sep 13 14:23:03.359610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 845/1754] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:03.545045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:03.547231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:03.553140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:03.553625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:03.554095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:03.554792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:03.555252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:03.555681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:03.586037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-00c34827-d81a-4685-9319-2e01e58f6df7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045444 Sep 13 14:23:03.586588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 910/1755] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:03.797082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:03.799169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:03.805031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:03.805510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:03.805974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:03.806662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:03.807113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:03.807536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:03.836515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37517b8f-65de-4ffc-b4d6-9db304dcce56 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Sep 13 14:23:03.837061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 846/1756] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:04.371827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:04.374082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:04.380464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:04.380936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:04.381362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:04.382096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:04.382578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:04.382999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:04.412930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-40116062-3d30-431c-af72-f7cf10c52767 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Sep 13 14:23:04.413474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 911/1757] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:04.598512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:04.600643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:04.607284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:04.607762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:04.608194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:04.608886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:04.609337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:04.609785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:04.639278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7d09b37-77a0-4b37-81d7-34594da3cb3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 13 14:23:04.639828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 847/1758] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:04.848466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:04.850575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:04.852417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:04.857660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:04.858244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:04.858676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:04.859361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:04.859815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:04.860237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:04.864002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:04.889835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6d4854e8-f35c-4d8f-b0b4-d36a6d175d0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 Sep 13 14:23:04.890377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 912/1759] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:05.425863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:05.427977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:05.433813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:05.434952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:05.435495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:05.436294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:05.436738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:05.437154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:05.466662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc2c1d29-1923-4b9f-adf2-50f550e97bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Sep 13 14:23:05.467213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 848/1760] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:05.652081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:05.654671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:05.663188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:05.663706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:05.664176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:05.664893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:05.665344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:05.665790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:05.695064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-75280e2a-3811-4904-9f42-397098279865 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Sep 13 14:23:05.695604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 913/1761] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:05.902456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:05.905070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:05.911339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:05.911802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:05.912232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:05.912906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:05.913349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:05.913783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:05.941416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e13d1982-2233-449b-bcc2-28d5fec90945 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042876 Sep 13 14:23:05.941993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 849/1762] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:06.479320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:06.481774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:06.489968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:06.490458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:06.490892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:06.491587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:06.492045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:06.492469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:06.524503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b61d84a0-1d99-4b59-9aba-93fecf263dbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049051 Sep 13 14:23:06.525358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 914/1763] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:06.707982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:06.710202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:06.712069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=96 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:06.717206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:06.717675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:06.718125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:06.718804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:06.719249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:06.719664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:06.749169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d313f3b2-feca-49b4-9b3f-ca618d686c6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Sep 13 14:23:06.749717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 850/1764] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:06.953913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:06.956046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:06.962469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:06.962893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:06.963323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:06.964010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:06.964461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:06.964881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:06.994752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dcf6e717-c83c-44e2-9184-aa62eb8fc678 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Sep 13 14:23:06.995297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 915/1765] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:07.536822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:07.538989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:07.545477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.545994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.546427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.547119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.547573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.547995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.567395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:07.568066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:07.574596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.575981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.576546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.577252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.577713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.578303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.579515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-913c2d87-2d1d-4a94-b8b9-087b70bb97a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046616 Sep 13 14:23:07.580083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 851/1766] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:07.603648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:23:07.678385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05e09efe-5dfd-491f-906a-c09554613cfc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 204 len: 0 microversion: 2.1 time: 0.114510 Sep 13 14:23:07.678975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 916/1767] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:23:07 2022] DELETE /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:23:07.690166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:07.690166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:07.694353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.694829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.695257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.695946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.696400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.696817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.763445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:07.765890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:07.773141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.773457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.773801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.774509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:07.775121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:07.775555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:07.806481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3e29c430-1cbc-4751-97ac-ce63c4654ee1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048100 Sep 13 14:23:07.807416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 917/1768] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:08.007694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:08.010061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:08.018036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:08.018621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:08.019055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:08.019756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:08.020205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:08.020657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:08.051877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df38c621-485d-4a10-a159-bd59ffc8b46b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048045 Sep 13 14:23:08.052366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 918/1769] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:08.210127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:08.218452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0eb8781-1701-4ba8-9497-9fa5cd720c9e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.535098 Sep 13 14:23:08.219008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 852/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:08.591482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:08.593629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:08.599661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:08.600141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:08.600577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:08.601265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:08.601718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:08.602172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:08.631700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0cf369a7-dc36-4b97-9667-c8141bc41690 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Sep 13 14:23:08.632255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 919/1771] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:08.819236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:08.821373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:08.828628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:08.829101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:08.829527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:08.830235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:08.830679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:08.831096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:08.860062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcc52aad-4227-455f-90cb-42695396414e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044850 Sep 13 14:23:08.860600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 853/1772] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:09.065063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:09.067279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:09.073661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.074135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.074579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.075515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.076100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.076533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.105141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-89b57f93-a797-4c52-b6c5-4aa2d0689358 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Sep 13 14:23:09.105704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 920/1773] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:09.242398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:09.242999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:09.248886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.249355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.249800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.250485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.250930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.251346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.376910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:09.385058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c314264-14a9-4738-b04e-136ce80a1b4f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146516 Sep 13 14:23:09.385623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 854/1774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:09 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:09.645134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:23:09.647288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:09.653833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.654323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.654760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.655447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.655905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.656328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.746520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32d02850-6ccd-43bb-aba2-bb5ed42b9ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/action" status: 200 len: 41169 microversion: 2.1 time: 0.105375 Sep 13 14:23:09.747325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 921/1775] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:23:09 2022] POST /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369/action => generated 41169 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:23:09.873415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:09.875605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:09.882030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.882512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.882940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.883624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:09.884072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:09.884490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:09.914392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03582f35-651c-4bf5-be5f-e7cd30fc19c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045161 Sep 13 14:23:09.914874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 855/1776] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:10.119275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:10.121524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:10.128692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:10.129167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:10.129596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:10.130310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:10.130760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:10.131175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:10.161145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6932399c-5482-4ae2-8bd4-3ba6a50a2868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Sep 13 14:23:10.161690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 922/1777] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:10.408640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:10.409235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:10.415318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:10.415803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:10.416236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:10.416922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:10.417372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:10.417817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:10.422635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:10.548956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:10.557119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1941a5c9-5c1d-4abe-8bb1-19165e854efb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152375 Sep 13 14:23:10.557683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 856/1778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:23:10.926704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:10.928844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:10.935264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:10.935749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:10.936186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:10.936878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:10.937334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:10.937774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:10.966915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d856ee89-6e93-465d-80e6-6c3fbabb8596 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Sep 13 14:23:10.967462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 923/1779] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:11.173813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:11.175951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:11.182363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:11.182843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:11.183279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:11.183964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:11.184540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:11.185143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:11.214186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e449f2fd-945b-4a76-b62f-4a6fa88d7eb1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Sep 13 14:23:11.214736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 857/1780] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:11.581502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:11.582157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:11.588726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:11.589198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:11.589623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:11.590366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:11.590867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:11.591282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:11.770807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:11.779294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-716ee448-e2bc-4a1b-95e9-795bba686719 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.201603 Sep 13 14:23:11.782612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 924/1781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:23:11.979036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:11.981684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:11.987656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:11.988127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:11.988550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:11.989224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:11.989666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:11.990103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:12.019248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4a05c93-a927-4bd7-8ba9-72d1519ff53f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Sep 13 14:23:12.019796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 858/1782] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:12.227330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:12.229561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:12.236635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:12.237106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:12.237533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:12.238299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:12.238753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:12.239170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:12.268345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22b3d304-a2a2-41dc-a9e8-0b2132598d04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Sep 13 14:23:12.268884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 925/1783] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:12.802298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:12.802837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:12.809221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:12.809699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:12.810162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:12.810845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:12.811293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:12.811710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:12.936651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:12.944714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-939e741e-ada1-486c-b885-4e57e5ef8554 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146367 Sep 13 14:23:12.945282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 859/1784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:13.031474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:13.033904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:13.040283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:13.040766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:13.041194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:13.041912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:13.042370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:13.042791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:13.071802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad02132b-9351-4541-a1e5-5dbec4f142df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Sep 13 14:23:13.072288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 926/1785] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:13.280875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:13.283159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:13.290222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:13.290700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:13.291131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:13.291822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:13.292273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:13.292691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:13.321498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44a25f5b-b7c2-4d09-8fb4-291576e521de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Sep 13 14:23:13.322140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 860/1786] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:13.968647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:13.969256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:13.975159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:13.975656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:13.976082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:13.976761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:13.977207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:13.977623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:13.996263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:14.084585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:14.086759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:14.093953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:14.094430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:14.094863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:14.095548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:14.095999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:14.096413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:14.113584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:14.121827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58c63956-7e7c-4b24-8301-ed4ead952d25 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157882 Sep 13 14:23:14.122407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 927/1787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:13 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:14.125921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8da0433c-a9bf-4b8d-af32-2bb6ac915735 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Sep 13 14:23:14.126476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 861/1788] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:14.333698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:14.335853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:14.342915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:14.343400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:14.343834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:14.344525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:14.344992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:14.345403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:14.379412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-92d645f5-5d5a-4b38-87bb-0bc93ab68a26 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049682 Sep 13 14:23:14.379972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 928/1789] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:15.138122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:15.140251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:15.146191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:15.147018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:15.147497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:15.148023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:15.148726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:15.149171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:15.149585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:15.153012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:15.160575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:15.161083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:15.161525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:15.162266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:15.162757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:15.163181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:15.180845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8a017ca-d910-40c5-9625-b187a91f46b1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046593 Sep 13 14:23:15.181407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 862/1790] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:15.293202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:15.302221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d1bb660-7eff-4c4a-af71-6f26aa9f1fa1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.160074 Sep 13 14:23:15.302810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 929/1791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:15 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:23:15.391736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:15.394228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:15.400068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:15.400531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:15.400964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:15.401638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:15.402111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:15.402534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:15.432558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ef9cfec-adbe-4770-b1d8-4126d79be59d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Sep 13 14:23:15.433106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 863/1792] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:16.194130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:16.196268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:16.204074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:16.204559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:16.204997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:16.205692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:16.206175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:16.206598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:16.235749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1f75e7c6-76c6-4f80-925f-87ba735690c7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Sep 13 14:23:16.236297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 930/1793] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:16.326659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:16.327219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:16.333634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:16.334137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:16.334557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:16.335235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:16.335679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:16.336092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:16.444549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:16.446981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:16.452960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:16.453444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:16.453905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:16.454600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:16.455047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:16.455869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:16.470898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:16.479087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef6b2c6c-bc21-4ac8-b784-09677b80464f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157030 Sep 13 14:23:16.479652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 864/1794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:16 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:16.486494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2a5b05e-322a-484b-acbd-c5947e700459 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Sep 13 14:23:16.491240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 931/1795] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:17.248185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:17.250373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:17.256268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:17.256749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:17.257178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:17.257894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:17.258348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:17.258770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:17.288578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bebc3989-c4d3-4a5c-876b-cb954e1663ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Sep 13 14:23:17.289122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 865/1796] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:17.502756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:17.504904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:17.505774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:17.506969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:17.511379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:17.511871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:17.512308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:17.513588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:17.514153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:17.514298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:17.514581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:17.514709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:17.515077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:17.516048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:17.516524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:17.517352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:17.544915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7e38ce56-4f54-4d7c-9d1b-380aa2442cbe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Sep 13 14:23:17.545477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 932/1797] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:17.662423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:17.670606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7743834c-e94c-4427-8f62-281e1a859ec3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.168542 Sep 13 14:23:17.671106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 866/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:23:18.301458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:18.303633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:18.309584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:18.310099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:18.310664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:18.311342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:18.311790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:18.312210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:18.340518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b79a64d-0c40-4cb1-83ce-9ab257ec5b86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043129 Sep 13 14:23:18.341052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 933/1799] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:18.556535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:18.558731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:18.565232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:18.565708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:18.566181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:18.566867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:18.567312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:18.567726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:18.597833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76b5b3af-b735-48a8-bb37-6a8011e0809b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Sep 13 14:23:18.598645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 867/1800] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:18.694370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:18.695010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:18.702150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:18.702624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:18.703056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:18.703745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:18.704193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:18.704615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:18.832295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:18.840355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad5da64e-8649-4260-ad6a-bbceebcccabb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149940 Sep 13 14:23:18.840912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 934/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:19.352851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:19.355010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:19.361915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:19.362440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:19.362868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:19.363554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:19.363998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:19.364413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:19.394041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb36d5eb-a395-4694-800e-ba65c140fb86 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Sep 13 14:23:19.394614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 868/1802] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:19.610755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:19.612862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:19.618718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:19.619188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:19.619942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:19.620734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:19.621187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:19.621604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:19.651556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f5578139-0528-45b2-a3e7-c59f5c9959f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Sep 13 14:23:19.652103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 935/1803] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:19.864457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:19.865029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:19.871495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:19.871972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:19.872402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:19.873084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:19.873534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:19.873978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:19.998415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:20.006625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88e47974-dc09-43bc-ae90-ccae23e4420e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146093 Sep 13 14:23:20.007188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 869/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:19 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:20.407771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:20.410018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:20.416428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:20.416905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:20.417335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:20.418055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:20.418502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:20.418920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:20.448872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69321d74-d348-46b8-a455-2d22625cd3c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046233 Sep 13 14:23:20.449425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 936/1805] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:20.663810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:20.666124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:20.672300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:20.672833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:20.673264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:20.673981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:20.674457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:20.674872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:20.704333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-608f4c65-ba1a-466b-a157-68ec2bece873 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044391 Sep 13 14:23:20.704888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 870/1806] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:21.030185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:21.030822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:21.036681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:21.037153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:21.037581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:21.038286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:21.038734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:21.039153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:21.165146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:21.173958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d056e3a4-e4a8-4b66-b7b3-14d5b906fdf3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147560 Sep 13 14:23:21.174518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 937/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:21 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:21.462099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:21.464283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:21.471441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:21.471916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:21.472344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:21.473064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:21.473520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:21.473964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:21.503276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d7f9fa2-8a23-45cf-b61c-6a506eb219ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Sep 13 14:23:21.503836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 871/1808] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:21.716455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:21.719765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:21.726126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:21.726619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:21.727059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:21.727757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:21.728212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:21.728642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:21.758081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ddf81f53-30b7-44fb-824a-b795e0bdc2f5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045545 Sep 13 14:23:21.762890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 938/1809] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:22.197944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:22.198549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:22.205611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:22.206108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:22.206586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:22.207267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:22.207713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:22.208128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:22.340263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:22.343744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:22.349796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9570fb2-4d3f-43a6-b072-1a2c049a8c9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155759 Sep 13 14:23:22.350362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 872/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:22 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:22.515688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:22.518120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:22.524106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:22.524583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:22.525013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:22.525705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:22.526189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:22.526607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:22.555895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb5d779a-eee9-4a21-b26d-0fef0f44c534 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Sep 13 14:23:22.556442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 939/1811] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:22.771135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:22.773326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:22.781445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:22.782053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:22.782642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:22.783608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:22.784055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:22.784739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:22.816579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c2a7407-75c3-43cf-99f3-a9fc820a14f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049830 Sep 13 14:23:22.817143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 873/1812] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:23.373355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:23.374050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:23.380350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:23.380819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:23.381245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:23.381996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:23.382449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:23.382866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:23.511191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:23.520223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa3bb8e7-b492-43c7-af8b-ec62e54f264c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150763 Sep 13 14:23:23.520816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 940/1813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:23 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:23.568488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:23.570636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:23.576556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:23.577709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:23.578168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:23.578881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:23.579333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:23.579754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:23.608510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de86934d-ab3d-4510-b16b-80a09ddef8bf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Sep 13 14:23:23.609052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 874/1814] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:23.828540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:23.830717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:23.836655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:23.837135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:23.837562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:23.838280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:23.838728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:23.839145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:23.868234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c7ff8304-47b9-4740-bc0c-624f4181c990 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Sep 13 14:23:23.868784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 941/1815] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:24.543451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:24.544062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:24.551428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:24.551938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:24.552365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:24.553051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:24.553496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:24.553981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:24.620692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:24.622865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:24.634248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:24.634738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:24.641880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:24.643012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:24.643488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:24.643917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:24.677703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c5e25d1-8823-4966-a882-6a52a4d7191f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060851 Sep 13 14:23:24.678286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 942/1816] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:24.723703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:24.732055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f6af280-4b3d-49dc-8b90-d8b2cc52ca02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.192709 Sep 13 14:23:24.732742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 875/1817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:24.886968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:24.889160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:24.896231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:24.896715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:24.897178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:24.897950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:24.898344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:24.898767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:24.929326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-be4228b4-d59a-4bc8-a3fd-df02e41597bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046384 Sep 13 14:23:24.929922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 943/1818] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:25.690670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:25.692793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:25.699162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:25.699644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:25.700080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:25.700771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:25.701226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:25.701644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:25.732206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6288e8c5-8fde-4b21-9406-8d990d51748b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Sep 13 14:23:25.732763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 876/1819] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:25.755425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:25.756030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:25.762319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:25.762787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:25.763217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:25.763894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:25.764406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:25.765387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:25.769510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:25.899059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:25.907626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88aaac6e-8799-40cc-81a3-a24038fa09f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155998 Sep 13 14:23:25.908201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 944/1820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:25 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:25.942289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:25.944052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:25.950100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:25.950581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:25.951046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:25.951734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:25.952843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:25.953401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:25.985932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-739aae95-69a6-4552-b9ec-e367aacd4682 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048164 Sep 13 14:23:25.990943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 877/1821] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:26.744410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:26.746643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:26.752875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:26.753365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:26.753829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:26.754526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:26.754979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:26.755403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:26.785423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-265003ca-4654-4210-be54-395f6cfe94d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Sep 13 14:23:26.790110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 945/1822] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:26.932590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:26.933195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:26.939646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:26.940118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:26.940544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:26.941228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:26.941675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:26.942118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:26.998226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:27.000918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:27.007015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:27.007500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:27.007955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:27.008713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:27.009153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:27.009577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:27.042529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4299bb22-2839-4d81-95a6-2668c478efc0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Sep 13 14:23:27.043016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 946/1823] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:27.077850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:27.085972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ab8c1a1-f8b5-4939-a214-687eeab83ee6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157200 Sep 13 14:23:27.086533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 878/1824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:26 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:27.797507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:27.799719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:27.806083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:27.806568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:27.807004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:27.807697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:27.808150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:27.808570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:27.840019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b3dc129-d84d-4f1b-a506-36ee061e7769 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Sep 13 14:23:27.840563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 947/1825] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:28.055232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:28.057341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:28.064314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:28.064785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:28.065221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:28.065929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:28.066372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:28.066787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:28.095623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91c5b902-2b7d-49ec-8b01-1eef2aacafc7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Sep 13 14:23:28.096186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 879/1826] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:28.110230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:28.110922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:28.116904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:28.117459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:28.118001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:28.118780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:28.119304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:28.119795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:28.246341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:28.255298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5709d4cc-6d5c-4320-bb92-72b148251104 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149094 Sep 13 14:23:28.255860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 948/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:28 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:28.852615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:28.854769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:28.861628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:28.862131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:28.862557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:28.863249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:28.863692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:28.864104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:28.892981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d4475d4-3614-4433-9c05-1f39fff1f26d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Sep 13 14:23:28.893665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 880/1828] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:29.108311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:29.110397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:29.116714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:29.117193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:29.117618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:29.118330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:29.118779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:29.119194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:29.151267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d783734-76c6-4b6e-8afd-7f42b13292c3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Sep 13 14:23:29.151835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 949/1829] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:29.279125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:29.279733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:29.286993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:29.287470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:29.287905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:29.288584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:29.289033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:29.289450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:29.416270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:29.424474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a133adc4-b871-46df-9fbb-6604de892578 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149191 Sep 13 14:23:29.425071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 881/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:29 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:29.905119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:29.907300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:29.913275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:29.913788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:29.914223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:29.914919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:29.915383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:29.915805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:29.947145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-15d1f274-fb86-4a4d-99c5-1efbe983a95d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045978 Sep 13 14:23:29.947706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 950/1831] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:30.164135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:30.166268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:30.172754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:30.173226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:30.173656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:30.174362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:30.174805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:30.175220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:30.203689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a834459-3458-49c6-8ffd-e15e37d09c78 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Sep 13 14:23:30.204449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 882/1832] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:30.448124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:30.448649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:30.455097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:30.455570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:30.456016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:30.456673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:30.457119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:30.457531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:30.587162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:30.595958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-257ab3d8-9ec8-4fd2-8592-a3a91a211ca3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151735 Sep 13 14:23:30.596529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 951/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:30 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:30.959532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:30.961713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:30.968267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:30.968828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:30.969168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:30.969938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:30.970411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:30.970816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:31.000306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1df4a6e8-eca6-444a-ba95-1dd0c8a54862 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Sep 13 14:23:31.000870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 883/1834] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:31.216266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:31.218583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:31.224490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:31.224968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:31.225396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:31.226099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:31.226548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:31.226966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:31.256236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56849580-4f75-4690-a7d0-c7c410291cae tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Sep 13 14:23:31.256799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 952/1835] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:31.619232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:31.619877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:31.626658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:31.627134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:31.627565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:31.628249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:31.628699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:31.629121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:31.758454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:31.766747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bd612c3-ce00-42ce-a9c2-ebb95b889d53 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151442 Sep 13 14:23:31.767585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 884/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:31 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:32.012765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:32.015140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:32.021955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:32.022438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:32.022868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:32.023551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:32.024002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:32.024419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:32.055359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c97fe663-4767-45f4-9e45-ea1f9e876bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046534 Sep 13 14:23:32.055921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 953/1837] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:32.269779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:32.271936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:32.278528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:32.279026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:32.279443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:32.281054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:32.281511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:32.281962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:32.312343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56069a9c-196d-48ef-9ccb-907ae8ef0599 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Sep 13 14:23:32.313676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 885/1838] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:32.791181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:32.791730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:32.798454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:32.798933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:32.799369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:32.800061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:32.800515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:32.800942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:32.931516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:32.940249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa4360d8-11b1-4b0a-8d91-2da66b877b2e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153227 Sep 13 14:23:32.940805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 954/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:32 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:33.068362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:33.070439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:33.076337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:33.078190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:33.078190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:33.078190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:33.078432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:33.078784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:33.108646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-471da0c5-31d5-4b0c-80a2-e7a87678effb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Sep 13 14:23:33.109286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 886/1840] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:33.324502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:33.326615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:33.333151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:33.333636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:33.334135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:33.334829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:33.335280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:33.335700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:33.365240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-92597c0a-ec8e-47dc-b237-b3ca5eb0a8e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044697 Sep 13 14:23:33.365804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 955/1841] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:33.963817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:33.964429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:33.970861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:33.971338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:33.971770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:33.972454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:33.972913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:33.973332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:34.100576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:34.108770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c37c563-5cf4-4caf-b21d-eeb1e86e6a8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148805 Sep 13 14:23:34.109328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 887/1842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:33 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:34.120263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:34.122474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:34.129004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:34.129474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:34.129949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:34.130628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:34.131078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:34.131496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:34.162317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9c633289-8d84-440c-88f3-08009a29f1ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045871 Sep 13 14:23:34.162885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 956/1843] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:34.378850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:34.381004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:34.387065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:34.387540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:34.387967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:34.388649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:34.389093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:34.389972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:34.419164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62303d3f-6589-454e-90a8-5532b6367171 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Sep 13 14:23:34.419708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 888/1844] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:35.132651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:35.133253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:35.135634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:35.141300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:35.141791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:35.142222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:35.143153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:35.143599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:35.144026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:35.175212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:35.177556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:35.184167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:35.184728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:35.185236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:35.186009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:35.186497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:35.186924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:35.205814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:35.221232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-107d167d-d578-4867-b704-3bddd680dfcd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050005 Sep 13 14:23:35.222010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 889/1845] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:35.279086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:35.287902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef95c3fe-8c3f-45fa-9a20-7c66af5b6c81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.159125 Sep 13 14:23:35.288461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 957/1846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:35 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:35.433799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:35.435909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:35.442515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:35.442998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:35.443432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:35.444482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:35.444826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:35.445264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:35.485457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c8a57fc-e094-4301-8cac-0ee469e00c52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057306 Sep 13 14:23:35.486038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 890/1847] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:36.234616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:36.236785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:36.243160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:36.243641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:36.244076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:36.244760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:36.245214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:36.245638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:36.274615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7bec2478-5332-4abe-922f-a948e855b07b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Sep 13 14:23:36.275176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 958/1848] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:36.310836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:36.311623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:36.318062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:36.318532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:36.318957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:36.319635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:36.320097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:36.320492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:36.448739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:36.457268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39df3ef2-4026-459c-8b4c-8a8e2473fdaa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150218 Sep 13 14:23:36.457845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 891/1849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:36 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:36.498114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:36.500304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:36.507177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:36.507647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:36.508729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:36.509439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:36.509926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:36.510352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:36.542366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-392d2a08-f1cb-4d95-b2fd-c33bb299890b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048202 Sep 13 14:23:36.542916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 959/1850] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:37.286869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:37.289022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:37.290955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:37.296627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:37.297133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:37.297564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:37.298326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:37.298778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:37.299201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:37.329288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5ec16f0-5980-49fe-8ae2-1db02bdd44eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046421 Sep 13 14:23:37.329939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 892/1851] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:37.480290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:37.480890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:37.487885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:37.488358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:37.488782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:37.489456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:37.489931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:37.490351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:37.556780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:37.558958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:37.565893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:37.566378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:37.566805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:37.567507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:37.567954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:37.568372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:37.599481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ed7d16f-f6eb-4e31-afbc-1685f17b17a2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047750 Sep 13 14:23:37.601251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 893/1852] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:37.849749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:37.853152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:37.859233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-03d0e3ae-0a29-4839-8a80-234c8b88b2b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.382771 Sep 13 14:23:37.859793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 960/1853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:37 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:38.341785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:38.344568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:38.350966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:38.351446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:38.351881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:38.352563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:38.353015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:38.353443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:38.384769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ee137da-b38b-4a2f-a1b2-9f66c9f51b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Sep 13 14:23:38.385532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 894/1854] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:38.612371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:38.615015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:38.621168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:38.621647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:38.622330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:38.623103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:38.624090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:38.624732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:38.654441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-52a3ba2e-b13d-4136-a389-a95adb11e195 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046807 Sep 13 14:23:38.655121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 961/1855] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:38.882406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:38.882959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:38.888824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:38.889363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:38.889929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:38.890616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:38.891063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:38.891480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:39.018803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:39.026886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5093d412-0bb4-48ca-ae65-d9be2664c20e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148403 Sep 13 14:23:39.027451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 895/1856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:38 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:39.398765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:39.400933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:39.406912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:39.407390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:39.407827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:39.408512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:39.408966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:39.409397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:39.438226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f534e496-4767-428e-b1e6-334bed7a2b19 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Sep 13 14:23:39.438777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 962/1857] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:39.666797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:39.668961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:39.675858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:39.676339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:39.676892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:39.677448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:39.677926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:39.678350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:39.707334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa0d586f-c4eb-4301-9f44-53741d30ee33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Sep 13 14:23:39.707888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 896/1858] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:40.050721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:40.051349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:40.058015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:40.058492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:40.058984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:40.059680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:40.060126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:40.060539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:40.190234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:40.198356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54d7779f-0db7-4a6f-9aa4-54d3bcd4165b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151696 Sep 13 14:23:40.198911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 963/1859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:40 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:40.450736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:40.453402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:40.459742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:40.460257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:40.460689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:40.461379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:40.461852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:40.462271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:40.492715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a0f9662-1a8a-4788-921e-b164f194fc8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045952 Sep 13 14:23:40.493277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 897/1860] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:40.719588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:40.721713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:40.727573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:40.728049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:40.728477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:40.729163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:40.729607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:40.730052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:40.759896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d70af0b8-b94b-4a96-8456-b0c24d309cef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Sep 13 14:23:40.760450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 964/1861] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:41.220892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:41.221630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:41.228356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:41.228830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:41.229260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:41.230022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:41.230427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:41.230847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:41.372415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:41.381688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f47d44ee-c381-4c14-8395-01c57a0c0c02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.164701 Sep 13 14:23:41.382280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 898/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:41 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:41.506247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:41.508584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:41.515510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:41.515988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:41.516429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:41.517121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:41.517851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:41.518271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:41.549712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c6372749-9327-45c9-8f3d-89643ab6a3ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047613 Sep 13 14:23:41.550294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 965/1863] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:41.775332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:41.777611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:41.785460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:41.786113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:41.786580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:41.787346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:41.787850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:41.788275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:41.821224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96cff982-909f-4c35-b01b-ec028e66f52e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050645 Sep 13 14:23:41.821858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 899/1864] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:42.406432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:42.406967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:42.412835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:42.413330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:42.413757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:42.414444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:42.414897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:42.415317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:42.544991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:42.553585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-caf8a198-0474-4690-bb72-8765fe30ffe3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151163 Sep 13 14:23:42.554312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 966/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:42 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:42.561968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:42.564122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:42.570624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:42.571105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:42.571540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:42.572246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:42.572700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:42.573126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:42.601847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d4752c7-f8c5-498a-80ce-83bc70834f54 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Sep 13 14:23:42.602401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 900/1866] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:42.833457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:42.835658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:42.841555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:42.842071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:42.842502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:42.843200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:42.843757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:42.844176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:42.873185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fb36fb6a-45a1-416e-a1ed-f80dfda8371b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Sep 13 14:23:42.874327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 967/1867] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:43.578637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:43.579242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:43.585596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:43.586110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:43.586536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:43.587218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:43.587662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:43.588076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:43.614965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:43.617126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:43.624138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:43.624738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:43.625165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:43.625895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:43.626575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:43.627002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:43.657631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-245d779f-a98b-4d2e-92c2-5ab03fe5e241 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046510 Sep 13 14:23:43.658226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 968/1868] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:43.721934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:43.730061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0853769e-98aa-4b2a-9c7b-8a1e8c98b1a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155806 Sep 13 14:23:43.730616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 901/1869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:43 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:43.886143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:43.888212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:43.894470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:43.895382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:43.895382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:43.896028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:43.896476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:43.896908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:43.927989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-34823bba-d626-462d-8a2a-4fa23e55d2aa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045785 Sep 13 14:23:43.928554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 969/1870] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:44.669624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:44.671910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:44.678360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:44.678850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:44.679289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:44.679981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:44.680469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:44.680895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:44.711051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab59c008-3c28-43a1-8b9b-390cfaa67a11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Sep 13 14:23:44.711599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 902/1871] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:44.754463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:44.755148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:44.761350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:44.761862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:44.762304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:44.762994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:44.763443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:44.763864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:44.892792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:44.900814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee24a675-3293-4bea-adb9-2ca9f96c12e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150274 Sep 13 14:23:44.901373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 970/1872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:44 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:44.940291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:44.942434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:44.948215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:44.948680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:44.949102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:44.949800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:44.950329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:44.950750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:44.979487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b532875f-6721-4e3a-9fff-40d4721457d0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Sep 13 14:23:44.980043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 903/1873] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:45.724045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:45.726233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:45.732186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:45.732666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:45.733386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:45.734119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:45.734568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:45.734991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:45.763416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc4e9f1a-6f38-4b1f-8163-534d4bd96d57 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 Sep 13 14:23:45.763994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 971/1874] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:45.924166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:45.924808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:45.931268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:45.931743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:45.932175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:45.932857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:45.933309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:45.933735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:45.992548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:45.994755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:46.001241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:46.001746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:46.002181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:46.002871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:46.003322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:46.003759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:46.036926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0bb13f60-67bc-4daf-aa0e-1d17bfc9f8b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048305 Sep 13 14:23:46.037506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 972/1875] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:46.070631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:46.079572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff85dffd-b51c-4ca6-a990-fbefdf3c409e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.159444 Sep 13 14:23:46.080139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 904/1876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:45 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:46.776534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:46.778761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:46.785323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:46.785828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:46.786257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:46.786934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:46.787379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:46.787794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:46.821335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef8668d6-dbfa-4ea6-9863-b3e2ddfb3bf0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048736 Sep 13 14:23:46.821915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 973/1877] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:47.048654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:47.050779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:47.057090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:47.057564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:47.058017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:47.058699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:47.059144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:47.059560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:47.089039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcd0edd3-8974-4c5c-b44c-cc18bf8a59dc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Sep 13 14:23:47.089596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 905/1878] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:47.102564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:47.103359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:47.109621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:47.110133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:47.110560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:47.111246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:47.111693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:47.112109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:47.241177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:47.249293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2561003-4762-406a-bff1-bd988e3eeb58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150521 Sep 13 14:23:47.249880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 974/1879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:47 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:47.833602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:47.835753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:47.841722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:47.842315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:47.842748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:47.843428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:47.843874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:47.844636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:47.848270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:47.874080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ead13f52-5f72-4278-a711-664ee38a4a04 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044354 Sep 13 14:23:47.874622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 906/1880] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:48.101591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:48.103687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:48.110303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:48.110929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:48.111366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:48.112047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:48.112497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:48.112918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:48.141768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7c18f5f2-2b85-4154-a780-a11b8af36275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Sep 13 14:23:48.142333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 975/1881] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:48.273033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:48.273636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:48.280155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:48.280629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:48.281053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:48.282378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:48.282825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:48.283239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:48.415564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:48.424304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7b221a9-ad7c-452c-8160-3ee4da20d9f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155055 Sep 13 14:23:48.424858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 907/1882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:48 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:48.887328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:48.889410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:48.895634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:48.896113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:48.896544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:48.897233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:48.897687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:48.898139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:48.927710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7d70577b-e694-4645-80ee-0112568fc580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 13 14:23:48.928285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 976/1883] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:49.153890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:23:49.155963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:49.162615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.163080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.163510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.164182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.164625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.165039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.259044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8bf40e0-afa2-4254-aea6-a70c5a9ca975 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action" status: 200 len: 82536 microversion: 2.1 time: 0.108843 Sep 13 14:23:49.259719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 908/1884] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:23:49 2022] POST /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/action => generated 82536 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:23:49.274411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:49.274918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:49.281317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.282531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.282968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.283654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.284107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.284528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.302007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:23:49.363823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lazy-loading 'services' on Instance uuid 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:23:49.419738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Request method failure captured: Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments/d529c02d-aec4-4c38-85be-cf364eeb2bd6 HTTP/1.1 Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjIJA0uaN7bTnnnZIjNHC9gz54rYk1EGeWzpiHBx4xPk_vHijmFpKeXyT7A1cVJB01BynNtGbu8KnSf9nahmMUT7FNj7G1OyJgiDrUcA-tqiPbZNa2Q9EMAuQjrfyLAJuzyM05MFpy7XnYnW6hE8N3R30EmHnN5OQWR-ildxwopXpDexo Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: e9946e78bebe4d2a8d32a39120b0b978 Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-TestMinimumBasicScenario-1278595442 Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:23:49.422223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9946e78bebe4d2a8d32a39120b0b978"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e9946e78bebe4d2a8d32a39120b0b978"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e9946e78bebe4d2a8d32a39120b0b978"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e9946e78bebe4d2a8d32a39120b0b978"}]}] Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-TestMinimumBasicScenario-1278595442 Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: e9946e78bebe4d2a8d32a39120b0b978 Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1278595442 Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-TestMinimumBasicScenario-1278595442-project Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: b894ea45ef5f4dcca7ced8cd7834a25a Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-TestMinimumBasicScenario-1278595442-project Sep 13 14:23:49.423914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'server_id': '5dceb84b-c3a9-4933-b104-8c5d4cebc6ed', 'id': 'd529c02d-aec4-4c38-85be-cf364eeb2bd6'} Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 14:23:49.424679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:23:49.426203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:23:49.427677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:23:49.429260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) Sep 13 14:23:49.430745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:23:49.432090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ba2b6124-5a4e-42f0-af61-b2b0e69ceb7a) {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:23:49.432090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a71ab86a-bc6c-486d-8f81-60a791e78fce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments/d529c02d-aec4-4c38-85be-cf364eeb2bd6" status: 400 len: 269 microversion: 2.1 time: 0.153424 Sep 13 14:23:49.432090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 977/1885] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Sep 13 14:23:49 2022] DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed/os-volume_attachments/d529c02d-aec4-4c38-85be-cf364eeb2bd6 => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 14:23:49.447971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:49.448498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:49.455987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.456557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.457056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.457776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.458227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.458646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.596048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:49.604476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a485bcd-b896-4847-a06d-bf45e4647b02 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.160974 Sep 13 14:23:49.605042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 909/1886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:49 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:49.940726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:49.942954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:49.948871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.949349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.949814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.950527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:49.950978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:49.951396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:49.981145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d64b0620-af38-4fe9-8ee4-5b5dbe28fe9b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Sep 13 14:23:49.981690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 978/1887] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:50.627732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:50.628345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:50.634737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:50.635211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:50.635646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:50.636333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:50.636785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:50.637209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:50.766295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:50.774695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-422da025-8c54-416e-95b3-774bfc760fdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150897 Sep 13 14:23:50.775265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 910/1888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:50 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:50.994092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:50.996219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:51.003263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:51.003740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:51.004167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:51.004847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:51.005295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:51.005712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:51.034635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b68304eb-6d2c-43ab-81fd-a071cc521af4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044452 Sep 13 14:23:51.035256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 979/1889] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:51.797788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:51.798418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:51.804953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:51.805431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:51.805895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:51.806590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:51.807036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:51.807487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:51.936500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:51.945497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2f21af6-5cd4-4844-bca3-9d9e11050ab0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151581 Sep 13 14:23:51.946104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 911/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:51 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:52.047490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:52.049631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:52.056118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:52.056601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:52.057035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:52.057722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:52.058205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:52.058625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:52.088119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9139121-83b1-405d-9652-08b56250f6dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044602 Sep 13 14:23:52.088665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 980/1891] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:52.970065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:52.970664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:52.977044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:52.977512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:52.977971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:52.978648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:52.979093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:52.979506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:53.100011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:53.102189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:53.104610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:53.108618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:53.109100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:53.110153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:53.111012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:53.111472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:53.111893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:53.114895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b593da29-e156-4c06-91ef-1ad7e9381f36 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148624 Sep 13 14:23:53.115476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 912/1892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:52 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:23:53.141630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-29fddbba-4697-4363-99e0-35e50fd29bbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 Sep 13 14:23:53.142343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 981/1893] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:54.138565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:54.139152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:54.146428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:54.146906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:54.147333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:54.148046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:54.148488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:54.148968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:54.154358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:54.156758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:54.163183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:54.163673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:54.164627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:54.164811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:54.165271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:54.165695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:54.197434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb441f0e-4f7e-48ff-b425-e4112fc47d26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046946 Sep 13 14:23:54.198034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 982/1894] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:23:54.282655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:54.290758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cad0973-2a17-48fc-acc2-2cacd0255ce7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.156051 Sep 13 14:23:54.291315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 913/1895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:54 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:55.210481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:55.212628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:55.219258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:55.219648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:55.220210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:55.220947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:55.221397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:55.221838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:55.251908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ac3feb0-6f62-4c1a-b911-41ffa31e1d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 13 14:23:55.252466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 983/1896] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:55.314991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:55.315603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:55.321827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:55.322300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:55.322731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:55.323418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:55.323867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:55.324294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:55.449595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:55.458007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d86dfac3-f65b-4f0d-8216-50916dc2f168 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147337 Sep 13 14:23:55.458572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 914/1897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:55 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:56.264070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:56.266292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:56.273582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:56.274092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:56.274528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:56.275213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:56.275668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:56.276091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:56.305314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a245d4b4-2009-44b1-bf16-1ffee4a4efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Sep 13 14:23:56.305877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 984/1898] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:56.481195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:56.481833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:56.488662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:56.489142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:56.489577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:56.490305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:56.490757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:56.491181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:56.623579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:56.632141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32ff3839-dea5-43b3-9e4f-c90a843b285c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154797 Sep 13 14:23:56.632703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 915/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:56 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:57.318153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:57.321151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:57.327815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:57.328313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:57.328754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:57.330358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:57.330832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:57.331322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:57.360477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72dcbe92-7c89-4475-be97-abd9c1613ce5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Sep 13 14:23:57.361199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 985/1900] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:57.656367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:57.656979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:57.663688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:57.664167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:57.664608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:57.665300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:57.665769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:57.666193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:57.797058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:57.806191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c1d8ff4-1445-432b-9b2f-467b44275aa5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153662 Sep 13 14:23:57.806781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 916/1901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:57 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:58.372598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:58.374819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:58.381295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:58.381794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:58.382234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:58.382916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:58.383367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:58.383790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:58.413917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bd739899-c9df-4f42-b6aa-2582edab8355 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 13 14:23:58.414458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 986/1902] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:23:58.830760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:58.831368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:58.837655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:58.838162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:58.838590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:58.839268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:58.839711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:58.840125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:58.967978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:23:58.976409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4817fe48-03a1-4972-aaba-59230be617cd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150172 Sep 13 14:23:58.977197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 917/1903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:23:59.426429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:23:59.428706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:23:59.435103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:59.435583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:59.436027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:59.436715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:23:59.437175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:23:59.437604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:23:59.466523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ea9324c-9feb-4b90-bf37-ff794d52b453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Sep 13 14:23:59.467076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 987/1904] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:23:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:00.000490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:00.001102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:00.007704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:00.008176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:00.008605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:00.009280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:00.009722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:00.010167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:00.142432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:00.151049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37c49d4c-ac60-431d-8cb2-7f52cf8c756b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154520 Sep 13 14:24:00.151608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 918/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:23:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:00.479428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:00.481634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:00.488756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:00.489229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:00.489662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:00.490374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:00.490829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:00.491251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:00.521955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7fc88a7c-09c4-4350-9761-852abae3b08b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046394 Sep 13 14:24:00.522518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 988/1906] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:01.175018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:01.175699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:01.181866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:01.182432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:01.182859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:01.183544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:01.183995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:01.184408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:01.310256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:01.318591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b8fab6a-619e-440d-b2ad-413c51434bb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148077 Sep 13 14:24:01.319156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 919/1907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:01 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:01.535102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:01.537218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:01.543810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:01.544308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:01.544738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:01.545416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:01.545898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:01.546316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:01.574415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28eece78-ae5a-4a3b-889d-04c8d7cbadc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Sep 13 14:24:01.574958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 989/1908] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:02.343973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:02.344577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:02.351498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:02.351968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:02.352391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:02.353065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:02.353514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:02.353970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:02.482438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:02.491092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64654c9e-b67e-4178-9caa-20ecbef40160 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150945 Sep 13 14:24:02.491651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 920/1909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:02 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:02.587055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:02.589173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:02.596037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:02.596509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:02.596933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:02.597618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:02.598094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:02.598512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:02.627554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83f33a0b-a08a-4600-8f6e-ff3736c8f7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 Sep 13 14:24:02.628108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 990/1910] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:03.514623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:03.515188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:03.522540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:03.523023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:03.523451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:03.524139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:03.524586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:03.525003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:03.639870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:03.642572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:03.649151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:03.649637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:03.650110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:03.650815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:03.651271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:03.651701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:03.652702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:03.661619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ce858e7-98bf-4c43-abb2-3fe966853c3d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150893 Sep 13 14:24:03.662220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 921/1911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:03.682954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aa871f94-4cb5-44fa-b8d8-d3f82f42c0a6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Sep 13 14:24:03.683509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 991/1912] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:04.684689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:04.685304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:04.691905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:04.692389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:04.692830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:04.693526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:04.694012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:04.694436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:04.695168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:04.697392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:04.703742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:04.704258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:04.704757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:04.705457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:04.705943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:04.706368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:04.736417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d551049e-3449-452f-96da-dbfddbc88a8f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Sep 13 14:24:04.736983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 992/1913] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:04.823203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:04.831766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4950c1b-3a8f-47f2-ad94-119e11d1fb86 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150872 Sep 13 14:24:04.832343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 922/1914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:05.748006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:05.750224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:05.753369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=72 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:05.758512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:05.758995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:05.759429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:05.760117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:05.760572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:05.760993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:05.786060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:05.791100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-023839cf-5363-4ece-b51f-bce3490a63a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Sep 13 14:24:05.791647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 993/1915] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:05.855464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:05.856074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:05.863197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:05.863676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:05.864106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:05.864789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:05.865240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:05.865659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:05.869653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:05.996638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:06.005757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-003d322c-e9ec-40c9-954c-d92320b24259 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154046 Sep 13 14:24:06.006259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 923/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:06.804429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:06.806624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:06.812952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:06.813433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:06.814493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:06.815172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:06.815635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:06.816056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:06.851564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b097c3b0-019b-4fc5-a5a7-ebb7efc1219c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051349 Sep 13 14:24:06.852117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 994/1917] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:07.028983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:07.029590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:07.036626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:07.037098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:07.037527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:07.038290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:07.038736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:07.039154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:07.165359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:07.174015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f63b51d-9360-46ba-9dc7-a7085b6b1491 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148803 Sep 13 14:24:07.174576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 924/1918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:07.864003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:07.866060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:07.872392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:07.872872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:07.873310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:07.874038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:07.874497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:07.874927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:07.904934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-730e84e8-ef71-47d3-bacc-406b5c5c8254 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Sep 13 14:24:07.905476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 995/1919] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:08.197218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:08.197798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:08.200131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=66 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:08.205781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:08.206257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:08.206685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:08.207363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:08.207808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:08.208224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:08.338728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:08.347956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-176c361d-cc62-4c2d-a513-73620816e478 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154612 Sep 13 14:24:08.348534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 925/1920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:08 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:08.917666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:08.919771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:08.926628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:08.927102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:08.927531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:08.928210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:08.928658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:08.929082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:08.958102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c7c6c8e-4179-4471-bc87-2b2efcc0e547 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044369 Sep 13 14:24:08.958637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 996/1921] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:09.370305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:09.370909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:09.377247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:09.377716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:09.378173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:09.378850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:09.379298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:09.379716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:09.505581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:09.514105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-022ee751-cbe7-4269-bf9a-dccfaa3f0803 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147561 Sep 13 14:24:09.514692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 926/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:09 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:09.970761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:09.972885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:09.979517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:09.980087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:09.980530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:09.981214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:09.981672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:09.982122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:10.011189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ace37d9-2036-424c-984e-d24aeb01a0ad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Sep 13 14:24:10.011734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 997/1923] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:10.537680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:10.538316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:10.544648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:10.545119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:10.545546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:10.546253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:10.546703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:10.547118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:10.683184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:10.691569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f311feb-f5ad-41d9-824b-3ad02397af87 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157727 Sep 13 14:24:10.692136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 927/1924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:11.023839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:11.026010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:11.033171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:11.033655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:11.034118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:11.034807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:11.035264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:11.035689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:11.064361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c81554bd-6080-441a-92e8-63fab6271403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 13 14:24:11.064901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 998/1925] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:11.715182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:11.715791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:11.723280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:11.723756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:11.724185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:11.724955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:11.725407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:11.725849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:11.856620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:11.865157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-539143a6-1653-464f-9310-0fe6fe5d7e54 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153519 Sep 13 14:24:11.865441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 928/1926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:12.076824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:12.079496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:12.086022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:12.086499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:12.086928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:12.087607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:12.088058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:12.088476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:12.117741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10ac9019-2025-4ab2-a9f5-fb20b4e72485 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044870 Sep 13 14:24:12.118288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 999/1927] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:12.887752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:12.888352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:12.895052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:12.895523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:12.895947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:12.896626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:12.897071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:12.897485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:12.966805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:24:12.966951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:24:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 (ip 10.222.0.20) !!! Sep 13 14:24:13.025151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:13.033898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9c1599e-40f4-4766-a5a9-75777df9e05e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149989 Sep 13 14:24:13.034463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 929/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:13.130568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:13.132695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:13.139117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:13.139601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:13.140037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:13.140721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:13.141174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:13.141629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:13.172055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a79fe27-2b9b-4dde-9afb-13010a0607fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Sep 13 14:24:13.172623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1000/1929] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:14.057682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:14.058332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:14.065505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:14.065996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:14.066429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:14.067109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:14.067553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:14.067969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:14.184538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:14.186958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:14.193975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:14.194448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:14.194886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:14.195578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:14.196206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:14.196632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:14.200301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:14.208828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c0792d5-284f-4872-b8ab-2b2197bfef32 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155055 Sep 13 14:24:14.209391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 930/1930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:14 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:14.225966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a8d35042-f317-4d17-af82-2fc963cc580e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Sep 13 14:24:14.226521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1001/1931] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:15.232390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:15.233022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:15.237959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:15.240088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:15.240236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:15.240567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:15.240995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:15.241682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:15.242211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:15.242599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:15.246416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:15.246896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:15.247331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:15.248019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:15.248480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:15.248903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:15.279207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c40a1785-4322-441a-87e1-0215f2cea113 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Sep 13 14:24:15.279769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1002/1932] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:15.369259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:15.378194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2de6b030-276f-4fb0-8f30-e6c33cb4ae24 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149659 Sep 13 14:24:15.378757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 931/1933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:15 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:16.291994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:16.294087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:16.296143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:24:16.296286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:24:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:24:16.302173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:16.302654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:16.303120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:16.303816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:16.304269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:16.304692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:16.335466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-64a5c3d4-e839-4d7f-a97b-b65bd7d85411 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047692 Sep 13 14:24:16.336036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1003/1934] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:16.402779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:16.403409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:16.410549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:16.411020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:16.411448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:16.412126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:16.412569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:16.412982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:16.554567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:16.562718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a3599fe-f3fd-495d-b1c8-6a23f5659e1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.163964 Sep 13 14:24:16.563276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 932/1935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:16 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:17.348728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:17.350926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:17.357506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:17.358014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:17.358453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:17.359145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:17.359632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:17.360060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:17.390228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0cf78a76-6293-4d6e-9cf4-250f02dec657 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Sep 13 14:24:17.390772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1004/1936] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:17.586306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:17.586913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:17.593326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:17.593899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:17.594331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:17.595564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:17.596010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:17.596426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:17.722093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:17.730359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16776789-525f-4f16-9a1b-45254d105948 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148077 Sep 13 14:24:17.730923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 933/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:18.403112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:18.405153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:18.411581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:18.412051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:18.412483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:18.413162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:18.413608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:18.414049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:18.442969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e0ce0a58-816f-42c1-ae04-3a3cd9582625 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Sep 13 14:24:18.443513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1005/1938] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:18.754701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:18.755311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:18.761778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:18.762260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:18.762689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:18.763400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:18.763847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:18.764267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:18.892088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:18.900435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99e03638-9ab8-4d5a-bffa-1412adc422e8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150288 Sep 13 14:24:18.900998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 934/1939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:19.455629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:19.457818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:19.464211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:19.464692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:19.465124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:19.465852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:19.466307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:19.466729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:19.496304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef649f44-efb6-4dbe-9ef3-0801dbfee9d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Sep 13 14:24:19.496852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1006/1940] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:19.924331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:19.924936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:19.931284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:19.931753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:19.932178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:19.932857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:19.933306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:19.933721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:20.065204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:20.073462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d80d0c4-67a5-4e94-85db-ea8401b2551c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153246 Sep 13 14:24:20.074065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 935/1941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:19 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:20.508569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:20.510752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:20.517058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:20.517556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:20.518281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:20.518956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:20.519402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:20.519816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:20.550033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cf2abc56-4b4e-4d11-9fda-1ef576325666 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Sep 13 14:24:20.550581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1007/1942] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:21.097411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:21.098045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:21.104420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:21.104919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:21.105350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:21.106070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:21.106519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:21.106941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:21.233244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:21.242249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73654556-67e3-40f8-a1ce-92cd72afcf81 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149115 Sep 13 14:24:21.242813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 936/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:21 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:21.562328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:21.564511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:21.570870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:21.571346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:21.571775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:21.572457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:21.572908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:21.573326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:21.602803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c5ea473e-2fe5-40dc-a3e8-2b5689ad1322 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Sep 13 14:24:21.603350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1008/1944] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:22.266411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:22.267049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:22.273850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:22.274329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:22.274758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:22.275447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:22.275903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:22.276323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:22.404853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:22.413223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-136d47ef-36cc-4d09-a9f7-9beed59802a5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150970 Sep 13 14:24:22.413820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 937/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:22 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:22.615736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:22.617884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:22.624265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:22.624739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:22.625166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:22.625910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:22.626363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:22.626780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:22.656678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-969ac568-c854-4d38-b1e6-cabe17f6a403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044834 Sep 13 14:24:22.657958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1009/1946] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:23.442873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:23.443517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:23.449704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:23.450206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:23.450660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:23.451345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:23.451793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:23.452240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:23.580006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:23.588090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-370c4173-5210-48b3-bdcc-38f21919412a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149582 Sep 13 14:24:23.588646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 938/1947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:23 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:23.669579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:23.671745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:23.678765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:23.679248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:23.679684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:23.680371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:23.680826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:23.681247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:23.697323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:23.711549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3fe7e72b-f264-4d31-b9cd-d0770683d8c8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Sep 13 14:24:23.712095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1010/1948] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:24.612468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:24.613083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:24.619477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:24.619980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:24.620456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:24.621086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:24.621530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:24.621973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:24.724280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:24.726564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:24.733044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:24.733603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:24.734084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:24.734777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:24.735852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:24.736258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:24.768290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05e1c42c-ba3d-4ad7-8e75-12ed22f3d4a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047828 Sep 13 14:24:24.768880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1011/1949] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:24.841287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:24.845537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:24.851441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ef5b219-4c62-4fd6-996c-58a5f7d4392a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.243603 Sep 13 14:24:24.852021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 939/1950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:25.782769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:25.784895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:25.791277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:25.791754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:25.792215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:25.792909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:25.793365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:25.793808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:25.823106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-04385a49-bc9b-41ab-9c46-e36d4011dcdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Sep 13 14:24:25.823644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1012/1951] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:25.876850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:25.877497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:25.883967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:25.884436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:25.884861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:25.885543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:25.886015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:25.886434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:26.015699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:26.024544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b89a10a-27ec-4d66-9574-5ca30d3cca1d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152360 Sep 13 14:24:26.025113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 940/1952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:25 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:26.836068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:26.839070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:26.846597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:26.847221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:26.847658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:26.848355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:26.848816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:26.849235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:26.878551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1bb9f304-6d5e-4b9d-b60d-16eba9864b3d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Sep 13 14:24:26.879104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1013/1953] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:27.047702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:27.048317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:27.054915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:27.055399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:27.055837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:27.056532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:27.056984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:27.057410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:27.184177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:27.193158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f4a564c-5234-493e-b4d7-b882871efe52 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149320 Sep 13 14:24:27.193759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 941/1954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:27 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:27.891249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:27.894056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:27.900366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:27.900844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:27.901271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:27.902106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:27.902627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:27.903048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:27.933887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ee97ead-e3df-44c7-8ddc-57b73bf11fae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046501 Sep 13 14:24:27.934432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1014/1955] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:28.217279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:28.217922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:28.224816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:28.225286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:28.225712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:28.226465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:28.226867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:28.227283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:28.358603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:28.367232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4087748b-8937-4253-b819-3c49eeb4cd6f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153695 Sep 13 14:24:28.367801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 942/1956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:28 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:28.946730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:28.948901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:28.955328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:28.955826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:28.956242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:28.956990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:28.957445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:28.957897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:28.987354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9f66960-f01f-4503-94e6-ff48abfd519a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Sep 13 14:24:28.987897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1015/1957] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:29.390841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:29.391861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:29.398324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:29.398796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:29.399224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:29.399902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:29.400350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:29.400763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:29.527536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:29.536271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2520ee7c-698a-41d6-930b-4500424e9300 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149236 Sep 13 14:24:29.536826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 943/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:29 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:29.999749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:30.001941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:30.008266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:30.008741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:30.009167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:30.009999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:30.010452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:30.010873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:30.045007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e4a7afdf-9329-4815-9f9e-3fc0983b0287 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049262 Sep 13 14:24:30.045554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1016/1959] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:30.560314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:30.560951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:30.568007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:30.568484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:30.568915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:30.569605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:30.570084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:30.570508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:30.702185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:30.711090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f22996e-16e2-4dcb-8735-557b1022b463 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154679 Sep 13 14:24:30.711871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 944/1960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:30 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:31.056975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:31.059162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:31.066275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:31.066753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:31.067180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:31.067871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:31.068310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:31.068732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:31.098073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c85bd39-1160-4f3d-83b9-0681b76b4530 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Sep 13 14:24:31.098604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1017/1961] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:31.736815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:31.737506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:31.744178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:31.744656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:31.745096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:31.745810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:31.746304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:31.746731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:31.875707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:31.883891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fcd4c5f5-3894-4302-b623-789769a87e8f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151650 Sep 13 14:24:31.884448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 945/1962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:31 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:32.110407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:32.112524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:32.118999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:32.119485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:32.119922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:32.120620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:32.121074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:32.121498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:32.151452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dd6fb89d-1109-4d34-a6eb-f508f93e3d8e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 Sep 13 14:24:32.152018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1018/1963] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:32.907167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:32.907739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:32.914377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:32.914855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:32.915288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:32.915978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:32.916429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:32.916848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:33.045149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:33.054242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb6773ca-05af-4437-b967-2a83298f9559 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150962 Sep 13 14:24:33.054807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 946/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:32 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:33.167953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:33.170061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:33.177093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:33.177567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:33.178577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:33.179489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:33.179938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:33.180351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:33.208741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-41465465-bf44-4383-b488-eab282b82792 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Sep 13 14:24:33.209289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1019/1965] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:34.078220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:34.078859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:34.081838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:24:34.081994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 (ip 10.222.0.20) !!! Sep 13 14:24:34.088606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:34.089081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:34.089511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:34.090238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:34.090677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:34.091101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:34.220001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:34.220486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:34.222634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:34.228830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:34.229016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3eb3bef-91e3-428d-8c13-9a1595ecc935 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154620 Sep 13 14:24:34.229307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:34.229795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 947/1966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:34 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:34.229939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:34.230443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:34.230892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:34.231310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:34.262372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec6d558e-af9e-458f-84d1-bdcc8466a989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Sep 13 14:24:34.262928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1020/1967] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:35.253093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:35.253635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:35.260357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:35.260825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:35.261254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:35.261967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:35.262413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:35.262828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:35.274777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:35.276936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:35.284242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:35.284725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:35.285154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:35.285876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:35.286330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:35.286756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:35.317384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82983bc2-46b9-4d65-98af-28c886f125d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046535 Sep 13 14:24:35.317988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1021/1968] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:35.391759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:35.400909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c53d5713-7707-40c7-a78c-9e8f95305e98 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151952 Sep 13 14:24:35.401476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 948/1969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:35 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:36.329771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:36.331864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:36.334155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=58 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:36.339316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:36.339795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:36.340221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:36.340899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:36.341405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:36.341857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:36.372927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a825e34a-3943-4007-8971-b09f504c191c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Sep 13 14:24:36.373513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1022/1970] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:36.424738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:36.425336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:36.431722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:36.432130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:36.432556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:36.433234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:36.433719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:36.434157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:36.570275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:36.578523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0759594-5df8-47e4-8a24-5421cb6cd187 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.158105 Sep 13 14:24:36.579094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 949/1971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:36 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:24:37.385842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:37.387991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:37.394815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:37.395301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:37.395736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:37.396425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:37.396879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:37.397306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:37.426239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e7d5cc7-a55f-4460-90a3-84be12147563 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Sep 13 14:24:37.426792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1023/1972] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:37.602524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:37.603131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:37.609506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:37.610019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:37.610448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:37.611826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:37.612243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:37.612666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:37.740296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:37.748405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8946ad7-a1dc-4eb1-bd07-bbd1cd1ba120 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149787 Sep 13 14:24:37.748961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 950/1973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:37 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:38.438083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:38.440910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:38.447381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:38.447862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:38.448293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:38.448975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:38.449428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:38.449890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:38.480139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fb3c3ec8-b1ad-409e-b41d-2a36e8e6e96c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046148 Sep 13 14:24:38.481004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1024/1974] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:38.772250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:38.772853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:38.775206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:38.780097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:38.780564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:38.780990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:38.781667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:38.782132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:38.782548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:38.911055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:38.919256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1cf69fa9-b8db-4c55-968a-48dd010a60a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151798 Sep 13 14:24:38.919825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 951/1975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:38 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:39.493157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:39.495347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:39.501624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:39.502128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:39.503274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:39.504101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:39.504554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:39.504970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:39.534214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-512acb21-73e9-4668-850f-4b606edb7ed7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Sep 13 14:24:39.534766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1025/1976] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:39.942395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:39.943011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:39.949500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:39.950001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:39.950437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:39.951126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:39.951577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:39.951998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:40.079218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:40.087656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1669935b-7a75-4f1f-86a4-7abbcaa3c49b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149302 Sep 13 14:24:40.088215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 952/1977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:39 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:40.546570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:40.548691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:40.555208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:40.555694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:40.556125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:40.556810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:40.557259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:40.557675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:40.587356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2e917d80-c22f-44ef-b6f1-ed9547007d80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Sep 13 14:24:40.587908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1026/1978] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:41.111023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:41.111632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:41.118734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:41.119209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:41.119641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:41.120328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:41.120777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:41.121199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:41.244535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:41.253538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5659a097-66e0-47ef-8e6b-46d0bca93886 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146239 Sep 13 14:24:41.254144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 953/1979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:41 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:41.600285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:41.602466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:41.608790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:41.609265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:41.609694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:41.610395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:41.610847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:41.611262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:41.615673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:41.640798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f5b3123c-53ec-4f18-9a62-05944cd0c568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Sep 13 14:24:41.641339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1027/1980] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:42.276276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:42.276886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:42.283337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:42.283888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:42.284329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:42.285013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:42.285463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:42.285909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:42.416284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:42.425459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d03ba6b6-8644-46d9-8235-766dd09f93ec tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152714 Sep 13 14:24:42.426146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 954/1981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:42 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:42.652593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:42.654770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:42.661199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:42.661675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:42.662139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:42.662811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:42.663258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:42.663674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:42.693196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af2d36f3-5a16-4624-960d-8faf55e7f3a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044560 Sep 13 14:24:42.693755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1028/1982] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:43.449613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:43.450263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:43.457560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:43.458071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:43.458502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:43.459234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:43.459685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:43.460108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:43.599679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:43.611032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-294b07fe-5fd6-4b97-85fc-64bdbef2fbb7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.165162 Sep 13 14:24:43.621535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 955/1983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:43 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:43.706493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:43.708629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:43.715032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:43.715509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:43.715939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:43.716616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:43.717068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:43.717477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:43.749416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ddf7e3c2-59cc-43b8-909d-9e119a2f4118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046809 Sep 13 14:24:43.750006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1029/1984] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:44.635550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:44.636186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:44.642720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:44.643775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:44.644206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:44.644927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:44.645462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:44.645838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:44.664304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:44.761681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:44.763840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:44.770687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:44.771165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:44.771594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:44.772273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:44.772719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:44.773133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:44.779046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:44.787357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9306d9d2-a907-4a74-9b3d-e0ce38763312 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155684 Sep 13 14:24:44.788014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 956/1985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:44 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:44.803011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc9776e1-22e7-4947-88b2-d0d90713763b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045270 Sep 13 14:24:44.803553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1030/1986] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:45.810258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:45.811022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:45.816196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:45.818408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:45.818543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:45.818889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:45.819323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:45.820022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:45.820472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:45.820951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:45.824780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:45.825268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:45.825702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:45.826430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:45.826887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:45.827328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:45.863215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30596f58-5504-4381-ae48-a50f47be082a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051771 Sep 13 14:24:45.863791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1031/1987] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:45.951981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:45.960902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e456f17f-a3e5-4ce9-8b1a-c1e5db280707 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154361 Sep 13 14:24:45.961413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 957/1988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:45 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:46.875823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:46.878719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:46.884716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:46.885277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:46.885805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:46.886558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:46.887056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:46.887486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:46.916581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fc4b046e-c438-4fc7-9650-b0602fb31d40 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Sep 13 14:24:46.917124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1032/1989] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:46.983829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:46.984462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:46.991361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:46.991850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:46.992258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:46.992937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:46.993379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:46.993823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:47.121136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:47.130158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc36bffb-e799-426b-a795-8039d91a3744 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150143 Sep 13 14:24:47.130721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 958/1990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:46 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:47.930001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:47.932134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:47.938623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:47.939104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:47.939537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:47.940814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:47.941267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:47.941695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:47.969678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4162c0cd-745a-4ba8-a92f-e079285e643b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043834 Sep 13 14:24:47.970249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1033/1991] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:48.153506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:48.154153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:48.161102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:48.161572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:48.162038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:48.162737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:48.163175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:48.163633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:48.289699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:48.297899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f75b41fa-5cfd-4f1e-92a0-71dbbc06f034 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148174 Sep 13 14:24:48.298466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 959/1992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:48 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:48.981983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:48.984065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:48.991202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:48.991676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:48.992103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:48.992780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:48.993226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:48.993643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:49.023079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9247e75-8d15-49fe-a878-d6e0f505471e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045134 Sep 13 14:24:49.023637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1034/1993] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:49.320923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:49.321528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:49.328160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:49.328628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:49.329050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:49.329749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:49.330195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:49.331137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:49.456381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:49.464474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b1b6dd2-43b7-4e90-b273-a8d9d0ae7ffa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147371 Sep 13 14:24:49.465032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 960/1994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:49 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:50.034571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:50.036631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:50.042957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:50.043438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:50.043872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:50.044557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:50.045010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:50.045435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:50.075359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-616fbf67-98ee-47cf-bf80-681b6d2860d6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044850 Sep 13 14:24:50.075903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1035/1995] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:50.488487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:50.489103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:50.495559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:50.496046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:50.496487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:50.497182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:50.497639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:50.498086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:50.634088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:50.642283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8711bad0-ddb5-47f8-995d-1e66162c662d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.158489 Sep 13 14:24:50.642939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 961/1996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:50 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:24:51.087832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:51.090003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:51.096327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:51.096806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:51.097242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:51.097966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:51.098424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:51.098847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:51.127796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c8ca4115-71ae-4d4f-b6fc-9d615283a8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043421 Sep 13 14:24:51.128406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1036/1997] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:51.666634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:51.667343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:51.673705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:51.674771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:51.675192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:51.675865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:51.676326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:51.676739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:51.802658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:51.810857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9955d047-c7d6-4f8e-b2df-d81ae58b5c19 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148020 Sep 13 14:24:51.811423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 962/1998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:51 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:52.139833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:52.141966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:52.149349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:52.149864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:52.150313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:52.151000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:52.151457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:52.151881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:52.181137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1fe1b6b4-c67c-437a-a57a-7891358742af tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045252 Sep 13 14:24:52.181680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1037/1999] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:52.834820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:52.835423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:52.841816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:52.842282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:52.842703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:52.843387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:52.843825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:52.844237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:52.974498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:52.982565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d662f2ae-79a7-4605-8f39-72973bc43ba5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151656 Sep 13 14:24:52.983129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 963/2000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:52 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:53.193668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:53.195760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:53.202116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:53.202593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:53.203022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:53.203703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:53.204158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:53.204575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:53.234344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d641b64f-6e66-4a6c-bfc9-d3ad46a4b989 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Sep 13 14:24:53.234901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1038/2001] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:54.005755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:54.006400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:54.012328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:54.012806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:54.013293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:54.014002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:54.014452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:54.014870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:54.140604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:54.149647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5694cd89-4684-4ab5-926d-5599c6c1c835 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147913 Sep 13 14:24:54.150258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 964/2002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:54 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:54.246761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:54.248896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:54.256001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:54.256509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:54.256965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:54.257643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:54.258127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:54.258546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:54.288486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ce008594-1bb3-42ee-bbe3-a477068a4801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Sep 13 14:24:54.289038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1039/2003] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:55.173288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:55.173940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:55.181013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:55.181492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:55.182005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:55.182722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:55.183173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:55.183594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:55.300708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:55.302782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:55.309158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:55.309643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:55.310105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:55.310538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:55.310789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:55.311239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:55.311653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:55.320155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-121d276e-03db-4364-94c7-d8bc00e9f48b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150805 Sep 13 14:24:55.320725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 965/2004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:55 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:55.341311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-02ed3f0e-4c2e-40e8-9bac-5b176f6e6801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Sep 13 14:24:55.341870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1040/2005] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:56.343741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:56.344344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:56.351485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:56.351962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:56.352426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:56.353113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:56.353556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:56.354001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:56.354391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:56.357851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:56.364911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:56.365338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:56.365876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:56.366567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:56.367024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:56.367446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:56.396741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd382849-249f-4e94-8135-a800c50e4f62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Sep 13 14:24:56.397321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1041/2006] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:24:56.484016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:56.492820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12120250-480c-4048-a178-81e690e34812 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152841 Sep 13 14:24:56.493388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 966/2007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:56 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:57.408639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:57.410881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:57.417333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:57.417907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:57.418344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:57.419029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:57.419505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:57.419925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:57.450491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-316ea56e-464d-425e-961e-a5fd7d27572f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Sep 13 14:24:57.451053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1042/2008] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:57.516579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:57.517281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:57.529396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:57.530045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:57.530488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:57.531191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:57.531671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:57.532584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:57.660022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:57.668003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d462bd4-f278-4aeb-958f-9223facefb31 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155496 Sep 13 14:24:57.668564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 967/2009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:57 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:58.462969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:58.465140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:58.472105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:58.472524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:58.472960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:58.473652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:58.474137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:58.474563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:58.499794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:24:58.505127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fc493dc5-68cd-40d1-95e6-bf4d12ee89ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046046 Sep 13 14:24:58.505692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1043/2010] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:58.691984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:58.692572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:58.698983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:58.699452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:58.699875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:58.700556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:58.701002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:58.701425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:58.840683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:24:58.848817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d923243d-c1d1-4db1-b818-bc096208f06a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.161284 Sep 13 14:24:58.849375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 968/2011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:24:59.517508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:59.519983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:59.527500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:59.527500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:59.527843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:59.528541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:59.529045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:59.529419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:59.559626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-464c1aba-2a70-47f5-9d3d-76560e7c6d2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Sep 13 14:24:59.560209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1044/2012] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:24:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:24:59.872198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:24:59.872809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:24:59.879143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:59.879619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:59.880051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:24:59.880736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:24:59.881186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:24:59.881607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:00.005671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:00.013742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cdea553e-3676-4c6a-84f6-5ad8468b3a1e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.145282 Sep 13 14:25:00.014315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 969/2013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:24:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:00.572201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:00.574391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:00.580746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:00.581221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:00.581647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:00.582352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:00.582802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:00.583220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:00.612305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f1eb6b51-929e-48d9-8282-2caa4c8d1fd7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043372 Sep 13 14:25:00.612781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1045/2014] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:01.038343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:01.038947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:01.045365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:01.045882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:01.046317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:01.047003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:01.047452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:01.047873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:01.178463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:01.186528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a9d5aa2-ceb5-43dd-9efd-04b3d71079f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151989 Sep 13 14:25:01.187090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 970/2015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:01 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:01.624448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:01.626771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:01.633672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:01.634199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:01.634635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:01.635327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:01.635806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:01.636229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:01.666313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-98c32733-ea93-4f6b-ad37-426bd612e30b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 13 14:25:01.666806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1046/2016] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:02.209845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:02.210463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:02.216784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:02.217267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:02.217707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:02.218497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:02.219027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:02.219463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:02.346661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:02.354733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8532d94-ede5-4e64-8ea9-08d5507e7662 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149202 Sep 13 14:25:02.355295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 971/2017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:02 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:02.679256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:02.681423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:02.687853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:02.688335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:02.688766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:02.689449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:02.690154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:02.690581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:02.719745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30f31d9e-ccef-44c5-8400-4ef8d31f3cba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Sep 13 14:25:02.720218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1047/2018] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:03.379440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:03.380074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:03.386570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:03.387049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:03.387478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:03.388166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:03.388616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:03.389037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:03.517242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:03.525771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcac3f5a-ed5c-46de-b5f0-541fbe58cc47 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150759 Sep 13 14:25:03.526652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 972/2019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:03.732903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:03.735133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:03.741990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:03.742470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:03.742898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:03.743580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:03.744033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:03.744457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:03.773869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a63d9d3b-3894-465c-ba99-a5bd56fbf5dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Sep 13 14:25:03.774356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1048/2020] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:04.548481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:04.549096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:04.555657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:04.556104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:04.556534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:04.557221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:04.557664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:04.558107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:04.562089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:04.692273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:04.700415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11725385-c12d-41d6-b8d8-fc45a03206ee tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155914 Sep 13 14:25:04.700979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 973/2021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:04.786264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:04.788596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:04.794977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:04.795525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:04.796151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:04.796878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:04.797330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:04.797770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:04.827532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f4c3f395-9747-44d5-afdc-9391801b2b7c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Sep 13 14:25:04.828029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1049/2022] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:05.723033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:05.723642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:05.730090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:05.730565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:05.730998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:05.731683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:05.732131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:05.732550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:05.840429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:05.842681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:05.849519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:05.850382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:05.851060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:05.851981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:05.852670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:05.853423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:05.865547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:05.873869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-555621d3-36c6-4be3-ae76-e532748ae953 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154649 Sep 13 14:25:05.874440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 974/2023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:05.886122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a09b042c-598d-4417-ad47-43f7be76685a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049502 Sep 13 14:25:05.886620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1050/2024] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:06.898494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:06.900111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:06.900859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:06.901289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:06.904577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=58 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:06.907554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:06.908228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:06.908648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:06.909343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:06.909847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:06.910383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:06.911645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:06.912136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:06.912569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:06.913260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:06.913718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:06.914165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:06.942623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-81cf29e8-459d-48b7-b835-ce2dbf29a805 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049154 Sep 13 14:25:06.943095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 975/2025] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:07.042676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:07.050871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10d67dc4-645b-4d1d-a092-fd4f68eb4858 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.156317 Sep 13 14:25:07.051607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1051/2026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:06 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:25:07.955163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:07.957892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:07.964374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:07.964854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:07.965285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:07.966104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:07.966438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:07.966857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:07.996945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0a13c04c-9691-4dd0-b185-e70a498a7379 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Sep 13 14:25:07.997477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 976/2027] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:08.075022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:08.075557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:08.082454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:08.082941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:08.083368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:08.084045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:08.084493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:08.084908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:08.213589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:08.221786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2599970-e02a-405c-b74a-88bfc279a328 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150696 Sep 13 14:25:08.222402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1052/2028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:08 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:09.009557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:09.011723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:09.014024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:09.019315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:09.019790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:09.020218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:09.020905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:09.021349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:09.021787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:09.052457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c964a43c-9096-40fa-abc7-193bd5c7b44b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046731 Sep 13 14:25:09.053009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 977/2029] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:09.245813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:09.246580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:09.252955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:09.253431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:09.254086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:09.254768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:09.255217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:09.255635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:09.382611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:09.390618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f52df630-8461-47ac-b37f-54574f0ab3a8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148704 Sep 13 14:25:09.391163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1053/2030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:09 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:10.064785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:10.067542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:10.073918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:10.074392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:10.074817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:10.075506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:10.075985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:10.076354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:10.106168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-130d965e-def9-403c-97f9-a008039ba546 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Sep 13 14:25:10.106717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 978/2031] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:10.415513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:10.416116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:10.422522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:10.422996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:10.423424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:10.424100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:10.424545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:10.425071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:10.554922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:10.563004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a87a5623-46a0-4406-8167-8769d3905ad2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151252 Sep 13 14:25:10.563571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1054/2032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:25:11.118206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:11.120423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:11.126769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:11.127247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:11.127677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:11.128371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:11.129004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:11.129444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:11.159537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bdb57298-1cce-44ac-8f11-b5ac2eee86d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Sep 13 14:25:11.160651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 979/2033] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:11.587438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:11.588037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:11.594683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:11.595161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:11.595589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:11.596261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:11.596708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:11.597123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:11.725761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:11.734100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a8c056b-0433-4410-b11b-0efd6efc268a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150377 Sep 13 14:25:11.734666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1055/2034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:12.172221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:12.174414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:12.181751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:12.182233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:12.182670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:12.183368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:12.183829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:12.184254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:12.214644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4bed67bb-8200-4414-92ca-7f823a5d2a5e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046276 Sep 13 14:25:12.215195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 980/2035] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:12.758979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:12.759547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:12.766504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:12.766938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:12.767375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:12.768075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:12.768536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:12.769216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:12.898299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:12.906294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2fa6969-33ce-475f-ae9d-339e71648622 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151473 Sep 13 14:25:12.906849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1056/2036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:13.227390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:13.229558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:13.236167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:13.236655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:13.237089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:13.237839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:13.238802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:13.239222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:13.269921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-290dcdd3-aa7d-47e6-97c5-9ccd42b2057b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Sep 13 14:25:13.270479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 981/2037] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:13.929421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:13.930075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:13.936400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:13.936872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:13.937295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:13.937996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:13.938441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:13.938854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:14.066651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:14.074679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4c116ca8-4440-422b-9d30-419c6229bb7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149151 Sep 13 14:25:14.075236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1057/2038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:13 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:14.282322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:14.284472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:14.291060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:14.291427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:14.291864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:14.292562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:14.293022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:14.293446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:14.323437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad6c8868-c89d-4d4f-a99a-bd60727917e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Sep 13 14:25:14.324005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 982/2039] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:15.097137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:15.098382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:15.104736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:15.105207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:15.105633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:15.106330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:15.106791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:15.107193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:15.237489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:15.246346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-64bc3513-3345-4c0b-871c-c018b47dc280 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153012 Sep 13 14:25:15.246909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1058/2040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:15 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:15.335794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:15.337998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:15.344384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:15.344868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:15.345508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:15.346024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:15.346485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:15.346930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:15.377818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14b17045-5326-4100-ad16-9dfdd71677a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045951 Sep 13 14:25:15.382588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 983/2041] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:16.270714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:16.271317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:16.277367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:16.277891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:16.278325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:16.279060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:16.279513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:16.279939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:16.390276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:16.392459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:16.399217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:16.399686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:16.400110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:16.400807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:16.401250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:16.401696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:16.410173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:16.418807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8a83493-769a-400c-91a4-483c931004a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152170 Sep 13 14:25:16.419376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1059/2042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:16 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:16.433269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64494643-674e-4192-b559-b45cb6c631b8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Sep 13 14:25:16.433950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 984/2043] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:17.443494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:17.444105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:17.446116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:17.448303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:17.451743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:17.452329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:17.452833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:17.453524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:17.454086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:17.454505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:17.454940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:17.455414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:17.455909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:17.456603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:17.457853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:17.458439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:17.476118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:17.495361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cdb8805a-aea3-4de9-a675-5004c91d4037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053164 Sep 13 14:25:17.496240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 985/2044] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:17.596139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:17.604311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec96c3b4-fc4a-48fa-b5fc-14f674810661 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.165315 Sep 13 14:25:17.604872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1060/2045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:18.507125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:18.509272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:18.515724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:18.516194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:18.516619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:18.517299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:18.517763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:18.518181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:18.549078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e26274d-4a63-48b6-b3e3-95838a46efed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045889 Sep 13 14:25:18.549641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 986/2046] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:18.627670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:18.628306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:18.634597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:18.635099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:18.635521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:18.636192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:18.636637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:18.637050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:18.762912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:18.771989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1db38e37-da3d-461a-835b-e27cfbcf1e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148164 Sep 13 14:25:18.772542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1061/2047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:19.560509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:19.562704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:19.569553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:19.570054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:19.570481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:19.571154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:19.571599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:19.572018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:19.603667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff7d8fdc-445d-4b2b-9417-ac4a6500cb3c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047035 Sep 13 14:25:19.604250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 987/2048] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:19.794841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:19.795442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:19.801915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:19.802390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:19.802816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:19.803490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:19.803933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:19.804346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:19.934445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:19.943624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d808aa3-eeb2-4f71-8445-f6a2f651eb9a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152501 Sep 13 14:25:19.944197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1062/2049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:19 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:20.616449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:20.618632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:20.625019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:20.625500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:20.625989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:20.626682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:20.627137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:20.627592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:20.658304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c41974a5-f720-4eaa-a809-d18dc3d49aee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Sep 13 14:25:20.659211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 988/2050] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:20.967065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:20.967705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:20.974883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:20.975357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:20.975784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:20.976456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:20.976902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:20.977315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:21.103634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:21.111641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b66408ff-f468-4635-b5e1-854eb015e02b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148511 Sep 13 14:25:21.112198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1063/2051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:20 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:21.670525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:21.672683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:21.679612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:21.680085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:21.680512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:21.681207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:21.681634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:21.682080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:21.706764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:21.711943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c758ffa9-0493-4725-a0f1-52cd3cf4266d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Sep 13 14:25:21.712495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 989/2052] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:22.134622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:22.135231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:22.141568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:22.142074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:22.142505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:22.143182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:22.143630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:22.144966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:22.273233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:22.281340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0129605f-9d75-40ef-9b95-d750e7f48325 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150470 Sep 13 14:25:22.282030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1064/2053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:22 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:22.724292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:22.726478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:22.733060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:22.733537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:22.734016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:22.734710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:22.735167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:22.735607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:22.764890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29a319db-b412-4521-a82c-e68360517d9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044617 Sep 13 14:25:22.765439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 990/2054] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:23.305833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:23.306444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:23.312828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:23.313303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:23.313755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:23.314445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:23.314897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:23.315388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:23.445016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:23.453107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e57f57fa-120b-41ae-8a6c-199b6788de0f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151892 Sep 13 14:25:23.453645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1065/2055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:23 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:23.778468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:23.780697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:23.787442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:23.787922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:23.788355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:23.789040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:23.789501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:23.789948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:23.818533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0329d1bb-3c64-4374-a8ca-4b18fc5ef969 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Sep 13 14:25:23.819077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 991/2056] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:24.476064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:24.476677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:24.483178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:24.483663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:24.484096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:24.484784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:24.485234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:24.485660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:24.615442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:24.623554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bd2f99ed-9371-4116-9fdc-d29d37cba91a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151899 Sep 13 14:25:24.624115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1066/2057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:24.830766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:24.833004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:24.840195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:24.840712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:24.841147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:24.841904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:24.842360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:24.842782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:24.873223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f72b3f5-3b38-4856-a37b-1fa265cfcc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046405 Sep 13 14:25:24.873794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 992/2058] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:25.648388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:25.648997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:25.655371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:25.655854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:25.656286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:25.657003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:25.657457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:25.657992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:25.798070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:25.806866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0afd427-fc8e-461c-a2df-aaff7f654b15 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.163203 Sep 13 14:25:25.807744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1067/2059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:25 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:25.885575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:25.887747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:25.894267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:25.894744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:25.895175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:25.895907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:25.896359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:25.897296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:25.927340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-81ccc4e3-d107-4c54-8bed-25c8ef23a99c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Sep 13 14:25:25.927927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 993/2060] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:26.830028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:26.830639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:26.837650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:26.838176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:26.838609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:26.839289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:26.839740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:26.840159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:26.939829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:26.942027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:26.949290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:26.949800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:26.950234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:26.950919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:26.951377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:26.951781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:26.971446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:26.980680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca6d434c-34e6-4947-9cb4-c355e233dece tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154517 Sep 13 14:25:26.981438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1068/2061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:26 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:26.981580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0da6b3ae-e7fd-4f73-9ab9-d7f0724e825c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045408 Sep 13 14:25:26.981976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 994/2062] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:27.994222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:27.996423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:28.002911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:28.003389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:28.003737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:28.004175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:28.004364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:28.004480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:28.004925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:28.005380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:28.010961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:28.011433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:28.011861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:28.012549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:28.012995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:28.013409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:28.034640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3442450d-1671-4260-b127-5332064d87f8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Sep 13 14:25:28.035183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1069/2063] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:28.145060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:28.154263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e53f8062-3a2f-4b62-a7d3-7776e6921f55 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154349 Sep 13 14:25:28.154832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 995/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:27 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:25:29.047428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:29.049683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:29.056153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:29.056637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:29.057063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:29.057754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:29.058214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:29.058631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:29.088568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0c0d709-100f-4ca2-9c37-28047084a0d5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Sep 13 14:25:29.089116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1070/2065] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:29.178745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:29.179453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:29.186024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:29.186506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:29.186938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:29.187626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:29.188072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:29.188488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:29.315758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:29.324463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32ca49e6-ae51-4c72-be32-89beb943253e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149704 Sep 13 14:25:29.325023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 996/2066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:29 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:30.101051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:30.103327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:30.109757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:30.110248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:30.110688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:30.111376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:30.111835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:30.112262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:30.141564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-07a83e6d-2ed5-4c77-a24a-8abdf9649fe9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Sep 13 14:25:30.142131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1071/2067] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:30.348333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:30.348942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:30.355477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:30.355958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:30.356389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:30.357075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:30.357522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:30.357974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:30.491849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:30.499936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e20b98f-57d9-4a2b-b6f2-2f9c475f27d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155436 Sep 13 14:25:30.500499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 997/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:30 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:31.154039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:31.156338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:31.163337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:31.163812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:31.164236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:31.164910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:31.165380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:31.165810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:31.194187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a1604c25-d7e8-463a-8258-a013291e238b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Sep 13 14:25:31.194721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1072/2069] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:31.524978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:31.525627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:31.532199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:31.532695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:31.533139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:31.533828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:31.534275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:31.534689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:31.660941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:31.669116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c766f5f7-82f2-426e-9957-72819ea04b1a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149024 Sep 13 14:25:31.669674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 998/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:31 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:32.206408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:32.208701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:32.215751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:32.216228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:32.216659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:32.217337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:32.217812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:32.218248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:32.247122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-daef06d9-6ccc-454f-ad33-9825b1621a7a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Sep 13 14:25:32.247667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1073/2071] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:32.692066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:32.692701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:32.699075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:32.699545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:32.699970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:32.700647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:32.701090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:32.701504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:32.825938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:32.834094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1505659-b87a-4207-ae02-69e661e48e6a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.145783 Sep 13 14:25:32.835252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 999/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:32 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:33.260092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:33.262381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:33.269076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:33.269586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:33.270038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:33.270716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:33.271155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:33.271583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:33.300601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82179eae-9a6c-49dd-bfd8-f9e938aed011 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045112 Sep 13 14:25:33.301137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1074/2073] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:33.858309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:33.858927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:33.865304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:33.866565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:33.867007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:33.867698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:33.868161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:33.868586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:33.998584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:34.006713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-abbaace8-0d2c-4361-bbf9-09f5bf926041 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152278 Sep 13 14:25:34.007271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1000/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:33 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:34.313350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:34.315622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:34.322230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:34.322710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:34.323145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:34.323827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:34.324279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:34.324698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:34.354545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3fd9dc48-a427-4825-8c1b-91170c9a4997 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Sep 13 14:25:34.355091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1075/2075] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:35.029817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:35.030428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:35.036725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:35.037193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:35.037875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:35.038559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:35.039030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:35.039448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:35.164709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:35.174690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ba49c95-5667-4578-b8fe-767beac74dbc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148621 Sep 13 14:25:35.175269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1001/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:35 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:35.366900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:35.369137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:35.375446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:35.375920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:35.376349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:35.377024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:35.377468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:35.377913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:35.408068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-908e7c5e-052e-463b-8164-73f4ac4f9ba0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Sep 13 14:25:35.408613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1076/2077] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:36.198345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:36.198957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:36.205330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:36.205845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:36.206283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:36.206969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:36.207415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:36.207835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:36.338378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:36.346502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-109ddbc8-cd27-4dd4-af05-ac7a13a3cd70 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152656 Sep 13 14:25:36.347056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1002/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:36 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:36.420305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:36.422569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:36.429854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:36.430331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:36.430757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:36.431429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:36.431878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:36.432295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:36.435969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:36.463559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-57991671-a56b-4639-9a3b-e838747aaeae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047093 Sep 13 14:25:36.464116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1077/2079] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:37.369448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:37.370019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:37.376833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:37.377305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:37.377750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:37.378454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:37.378913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:37.379334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:37.476184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:37.478421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:37.480751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=54 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:37.485968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:37.486446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:37.486875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:37.487556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:37.488004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:37.488420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:37.511365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:37.519566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-289f2d42-a8a6-44c3-bb7f-f97d4e1af8ae tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Sep 13 14:25:37.520025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69f738a2-e666-4999-a137-35f013a89c5d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154459 Sep 13 14:25:37.524912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1078/2080] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:37.525117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1003/2081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:37 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:38.532897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:38.535067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:38.541539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:38.542059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:38.542492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:38.543180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:38.543633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:38.543943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:38.544371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:38.544562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:38.551444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:38.551974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:38.552413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:38.553843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:38.554342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:38.554770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:38.575958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2a42e044-a41a-4dfa-944b-71ea121fdbad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046988 Sep 13 14:25:38.576535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1079/2082] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:38.691896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:38.701047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c7d8095-d9c7-40f1-af58-2c7968859d3c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.160882 Sep 13 14:25:38.701606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1004/2083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:38 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:25:39.588522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:39.590687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:39.597009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:39.597481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:39.597954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:39.598631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:39.599081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:39.599498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:39.628621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2f418fe2-fdfb-4eb7-84c6-23459c38c4d2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Sep 13 14:25:39.629151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1080/2084] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:39.724227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:39.725456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:39.727638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=56 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:39.732585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:39.733069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:39.733510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:39.734226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:39.734681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:39.735100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:39.860972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:39.869519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a8fda04-ff56-45ed-b690-56b41f47b505 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149160 Sep 13 14:25:39.870116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1005/2085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:39 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:40.641390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:40.643543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:40.650286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:40.650763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:40.651195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:40.651869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:40.652319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:40.652739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:40.684545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f30c2c34-fc2a-4753-b646-8a2ba2333f55 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046855 Sep 13 14:25:40.685102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1081/2086] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:40.893719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:40.894616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:40.901546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:40.902056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:40.902495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:40.903189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:40.903645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:40.904071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:40.922338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:41.030709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:41.039506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b65f36a6-6435-4716-ad68-4d1b6c68a26b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149608 Sep 13 14:25:41.040073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1006/2087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:40 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:41.697058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:41.699246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:41.701324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:25:41.701464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:25:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:25:41.707852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:41.708335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:41.708771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:41.710019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:41.710501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:41.710924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:41.741424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc9a3a82-c1f9-4ba6-8ff2-8e92f5bbeb49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048283 Sep 13 14:25:41.742004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1082/2088] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:42.063608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:42.064213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:42.071585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:42.072083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:42.072511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:42.073192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:42.073637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:42.074084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:42.205351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:42.213650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e908d3a9-6590-4a23-b5f5-9da21e90e2e1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153862 Sep 13 14:25:42.214251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1007/2089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:42 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:42.753614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:42.755777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:42.762535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:42.763007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:42.763433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:42.764103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:42.764552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:42.764965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:42.793758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a7381d9a-4077-42d6-948d-10f2bee0e646 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Sep 13 14:25:42.794284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1083/2090] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:43.237435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:43.238083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:43.244423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:43.244893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:43.245321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:43.246358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:43.246461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:43.246870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:43.374793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:43.383149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71524e38-80c1-4629-b84f-ae6f8ae12e61 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149543 Sep 13 14:25:43.383714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1008/2091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:43 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:43.806538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:43.808712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:43.815521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:43.815994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:43.816421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:43.817103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:43.817535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:43.817972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:43.847012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37165e16-90e6-4de3-b51a-2bb14aea6def tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045046 Sep 13 14:25:43.847542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1084/2092] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:44.408363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:44.409489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:44.418014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:44.418500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:44.418981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:44.419748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:44.420207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:44.420670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:44.565784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:44.574296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edc9692f-9145-4971-94d6-8ceea829817a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.171792 Sep 13 14:25:44.574864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1009/2093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:44 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:44.860684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:44.863419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:44.870157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:44.870645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:44.871076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:44.871772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:44.872228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:44.872649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:44.904898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b821ca4-753f-400a-8024-5342d301b593 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048448 Sep 13 14:25:44.905870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1085/2094] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:45.598920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:45.599570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:45.606209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:45.606684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:45.607109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:45.607794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:45.608237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:45.608652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:45.734810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:45.743554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e526cf8-de83-4dbd-91ec-a29c12d55031 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148469 Sep 13 14:25:45.744110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1010/2095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:45 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:45.917988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:45.920132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:45.926461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:45.926969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:45.927405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:45.928313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:45.928886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:45.929311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:45.958358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b92ff5fd-9189-4da8-aa38-d13e4da3b2ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Sep 13 14:25:45.958898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1086/2096] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:46.767100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:46.767709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:46.774444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:46.774921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:46.775352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:46.776037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:46.776489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:46.776912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:46.906324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:46.915599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6639666f-acd4-4024-832e-b32812be1399 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152340 Sep 13 14:25:46.916270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1011/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:46 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:46.971771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:46.973995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:46.981157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:46.981641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:46.982109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:46.982797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:46.983254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:46.983684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:47.013152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-03b3ab7c-39c5-4d29-873d-d1463b349d28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Sep 13 14:25:47.013702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1087/2098] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:47.939303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:47.939913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:47.946265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:47.946738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:47.947169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:47.947855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:47.948300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:47.948724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:48.025989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:48.028114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:48.034016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:48.034495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:48.034923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:48.035602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:48.036049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:48.036463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:48.067393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-afb28bc1-c141-4b86-9362-0accd2fa498c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 Sep 13 14:25:48.067960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1088/2099] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:48.079197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:48.087304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de3bc9b5-8bc6-4fa4-8535-013d28c7c303 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151860 Sep 13 14:25:48.087868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1012/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:47 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:49.079927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:49.082255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:49.088753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:49.089235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:49.089667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:49.090370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:49.090831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:49.091250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:49.110163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:49.110804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:49.117767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:49.118246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:49.118681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:49.119375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:49.119830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:49.120247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:49.121769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d5f8c89-af26-4b43-be34-765d7bd631e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045708 Sep 13 14:25:49.122331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1089/2101] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:49.251012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:49.260227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32451a02-101b-4bca-a337-2d195024c6f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153823 Sep 13 14:25:49.260794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1013/2102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:49 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:25:50.134045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:50.136196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:50.142562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:50.143052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:50.143484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:50.144421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:50.144874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:50.145298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:50.174300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a262de8c-dce1-4b5c-ac46-0115ee9d665c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Sep 13 14:25:50.174851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1090/2103] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:50.284016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:50.284620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:50.291791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:50.292180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:50.292611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:50.293303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:50.293772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:50.294191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:50.425341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:50.437217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69104ffe-97e8-4fbd-a682-d8c152297b42 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157019 Sep 13 14:25:50.437831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1014/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:50 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:51.187638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:51.189848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:51.196991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:51.197470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:51.197934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:51.198621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:51.199074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:51.199530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:51.231109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-40d49b21-7fac-46ec-b72f-c67f1129c6bb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047339 Sep 13 14:25:51.231598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1091/2105] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:51.460613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:51.461215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:51.469209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:51.469771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:51.470213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:51.470911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:51.471445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:51.471855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:51.599452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:51.607732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f23ea50b-4363-43aa-b8e4-7bd03d290c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151193 Sep 13 14:25:51.608309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1015/2106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:51 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:52.243401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:52.245550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:52.252006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:52.252493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:52.252930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:52.253613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:52.254096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:52.254522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:52.284049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb494a5f-041a-4481-b9b2-991c3ec84abc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 13 14:25:52.284598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1092/2107] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:52.631016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:52.632136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:52.638671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:52.639148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:52.639576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:52.640265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:52.640709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:52.641123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:52.776300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:52.784854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed5c41bc-da53-48c5-827e-bb8eeb75c7f0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157583 Sep 13 14:25:52.785494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1016/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:52 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:53.297383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:53.299633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:53.306098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:53.306575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:53.307004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:53.307676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:53.308131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:53.308546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:53.333362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:25:53.339266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6fd83e89-5286-40f8-a49c-aa82f9ff6ac2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045735 Sep 13 14:25:53.339836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1093/2109] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:53.807145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:53.807757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:53.814649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:53.815120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:53.815548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:53.816238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:53.816681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:53.817097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:53.943693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:53.952512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f789c458-a120-4f1d-8239-98631c01bf7f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149338 Sep 13 14:25:53.953066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1017/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:53 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:54.352563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:54.354729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:54.360955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:54.361431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:54.361893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:54.362570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:54.363018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:54.363438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:54.392683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ece2ba3-7f01-48e0-abc5-221120c48c0f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Sep 13 14:25:54.393218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1094/2111] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:54.977114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:54.977801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:54.984144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:54.984611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:54.985035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:54.985714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:54.986180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:54.986595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:55.114997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:55.123392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cd24e4d-b85e-42d4-ab46-89599fff29e4 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150745 Sep 13 14:25:55.123959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1018/2112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:54 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:55.405136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:55.407310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:55.414268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:55.414864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:55.415303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:55.415990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:55.416446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:55.416870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:55.447192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82f26e68-76e9-4e8b-8883-da64842d92df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045973 Sep 13 14:25:55.447745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1095/2113] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:56.147190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:56.147801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:56.154270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:56.154746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:56.155174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:56.155858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:56.156304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:56.156721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:56.288375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:56.297116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21db8deb-2c60-4a28-bf15-9976ee9227fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153919 Sep 13 14:25:56.297679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1019/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:56 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:56.459515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:56.462240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:56.468854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:56.469333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:56.469788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:56.470469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:56.470924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:56.471346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:56.500392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7dd10ba-1a7b-4dc7-b55c-641c20cb285a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 13 14:25:56.500935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1096/2115] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:57.323170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:57.323816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:57.330187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:57.330692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:57.331126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:57.331822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:57.332282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:57.332683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:57.464197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:57.472344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa80e1a5-14ff-4c89-8165-f75650ff3ff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153710 Sep 13 14:25:57.472907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1020/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:57 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:57.512753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:57.514958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:57.521522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:57.522046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:57.522471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:57.523270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:57.523724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:57.524135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:57.553670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-210b745b-7897-4daf-868b-c0918e8d6ff6 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Sep 13 14:25:57.554901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1097/2117] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:58.496364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:58.496974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:58.503411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:58.503883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:58.504314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:58.504997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:58.505449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:58.505899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:58.566651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:58.569011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:58.575411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:58.575968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:58.576493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:58.577250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:58.577803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:58.578293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:58.609361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c801cfc3-5f8e-41e5-ac89-9b60a85b3d58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046583 Sep 13 14:25:58.610246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1098/2118] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:25:58.638135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:58.646490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76f079c9-17e2-4403-b95f-e02995c6c410 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153991 Sep 13 14:25:58.647051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1021/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:25:59.622435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:59.624551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:59.630886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:59.631361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:59.631789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:59.632465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:59.633098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:59.633520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:59.662487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0edc8906-ef06-49f8-b822-c2dc5ef19f21 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Sep 13 14:25:59.663031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1099/2120] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:25:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:25:59.670737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:25:59.671375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:25:59.677934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:59.678411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:59.678843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:59.680194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:25:59.680822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:25:59.681244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:25:59.805185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:25:59.813332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1e39ba72-7583-4270-8084-b15be0c4928c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146397 Sep 13 14:25:59.813932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1022/2121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:25:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:00.675672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:00.678492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:00.685795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:00.686276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:00.686705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:00.687387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:00.687837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:00.688252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:00.717467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f68e1736-2d61-45e5-b3c5-862cde6e8bba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Sep 13 14:26:00.718038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1100/2122] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:00.836906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:00.837534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:00.844084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:00.844555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:00.844984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:00.845664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:00.846137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:00.846553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:00.850533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:00.979854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:00.987962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35a08188-45ca-4ae1-9d52-24932eccf486 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154864 Sep 13 14:26:00.988530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1023/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:00 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:01.730985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:01.733138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:01.739596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:01.740075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:01.740507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:01.741193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:01.741648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:01.742093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:01.771864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b400758b-62b8-4542-a247-9aa0d2edf84f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Sep 13 14:26:01.772420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1101/2124] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:02.012537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:02.013180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:02.019853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:02.020328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:02.020757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:02.021445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:02.021924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:02.022349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:02.151986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:02.160055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5f98b8b9-20ce-46c8-bf69-9755e893f1ef tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151336 Sep 13 14:26:02.160620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1024/2125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:02 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:02.784317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:02.786517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:02.793079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:02.793560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:02.794013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:02.794695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:02.795142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:02.795559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:02.824943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7979092c-058c-4a9f-b05c-1f93e2d76e77 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Sep 13 14:26:02.825483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1102/2126] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:03.183375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:03.183989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:03.190469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:03.190953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:03.191392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:03.192089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:03.192546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:03.192975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:03.321561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:03.330079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7eef4ec4-a8be-4401-a849-ff38ad0e4552 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150658 Sep 13 14:26:03.330739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1025/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:03.837774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:03.839923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:03.846334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:03.846819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:03.847252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:03.847937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:03.848392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:03.848819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:03.878329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33c4bc51-4be0-4685-afd3-db8b404068c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 13 14:26:03.878876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1103/2128] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:04.353914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:04.354458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:04.360783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:04.361262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:04.361699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:04.362418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:04.362891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:04.363317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:04.499218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:04.508081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98e7d4d5-1c12-45b4-8525-749a7c0976b6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157693 Sep 13 14:26:04.508633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1026/2129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:04.890829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:04.893072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:04.900080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:04.900566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:04.901000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:04.901688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:04.902166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:04.902605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:04.933843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f990d33e-2598-4229-bb7d-9c2e7ba59612 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046911 Sep 13 14:26:04.934396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1104/2130] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:05.530832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:05.531438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:05.538113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:05.539562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:05.539998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:05.540695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:05.541144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:05.541562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:05.667833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:05.676044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60e50119-360f-4290-9b91-c34fda2b0bfa tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149082 Sep 13 14:26:05.676820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1027/2131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:05.946963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:05.949044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:05.955362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:05.955840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:05.956303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:05.956978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:05.957425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:05.957874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:05.986720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef52a311-798b-46c6-8ba6-f55045d58a08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Sep 13 14:26:05.987253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1105/2132] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:06.698859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:06.699473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:06.705962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:06.706439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:06.706868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:06.707541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:06.708012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:06.708424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:06.838623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:06.846623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-814ef84d-169e-48c0-a5c5-0b94661c557c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151570 Sep 13 14:26:06.847179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1028/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:06 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:06.998932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:07.001133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:07.007501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:07.007975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:07.008399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:07.009086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:07.009632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:07.009963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:07.040853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-954106ef-d4d8-41c4-aab6-b9c1e86d174c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045765 Sep 13 14:26:07.041404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1106/2134] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:07.870731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:07.871335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:07.877803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:07.878284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:07.878714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:07.879393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:07.879842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:07.880261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:08.008448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:08.016642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73f03f65-ff08-40c3-8162-265b17c0a774 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150387 Sep 13 14:26:08.017210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1029/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:08.052232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:08.055106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:08.057544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=58 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:08.062779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:08.063257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:08.063700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:08.064370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:08.065009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:08.065428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:08.094699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-14467899-42fe-430c-8763-af6acc5a1c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046307 Sep 13 14:26:08.095242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1107/2136] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:09.040541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:09.041152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:09.047573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:09.048056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:09.048492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:09.049172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:09.049626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:09.050072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:09.106573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:09.108722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:09.115331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:09.115739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:09.117162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:09.117410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:09.117888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:09.118306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:09.155368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e0f7f10b-24a4-4e30-b8b3-019f4c7306e9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052635 Sep 13 14:26:09.156030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1108/2137] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:09.182611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:09.190712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c391cd2-7375-4a42-ba60-a347cb6aafd9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154504 Sep 13 14:26:09.191268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1030/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:09 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:10.167186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:10.169341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:10.175801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:10.176220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:10.176648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:10.177323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:10.177801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:10.178222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:10.208184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4e4c4600-c8e6-4622-8ef0-c9323068eabc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Sep 13 14:26:10.208920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1109/2139] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:10.215287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:10.216005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:10.218550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:10.223724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:10.224200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:10.224630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:10.225311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:10.225781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:10.226481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:10.356280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:10.364373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-418eba15-a884-4627-89e6-c4c57681570f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153786 Sep 13 14:26:10.364969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1031/2140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:26:11.220464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:11.222730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:11.230231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:11.230721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:11.231165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:11.231862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:11.232322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:11.232746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:11.250020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:11.264323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb695a8b-cf2a-42e5-80cb-960fdaa9f4e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Sep 13 14:26:11.264875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1110/2141] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:11.387756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:11.388389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:11.394999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:11.395466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:11.395888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:11.396564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:11.397007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:11.397418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:11.526346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:11.534502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd1e020a-7f92-4039-8489-c15c70666019 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150593 Sep 13 14:26:11.535059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1032/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:12.276586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:12.278782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:12.285521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:12.285996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:12.286410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:12.287092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:12.287542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:12.287964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:12.318020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-587f4fe1-60fb-43ec-8e65-2a1064c7260d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Sep 13 14:26:12.318577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1111/2143] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:12.558270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:12.558988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:12.565431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:12.566035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:12.566534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:12.567285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:12.567856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:12.568274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:12.698284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:12.706487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-170735b7-57c9-4cd9-af2b-eaac3cdfe14c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152899 Sep 13 14:26:12.707051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1033/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:13.329634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:13.331885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:13.339123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:13.339792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:13.340030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:13.340722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:13.341181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:13.341602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:13.374026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c412e7e0-df86-45d3-9282-02d4154e296f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048181 Sep 13 14:26:13.374590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1112/2145] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:13.730283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:13.730899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:13.742470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:13.742952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:13.743387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:13.744622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:13.745108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:13.745498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:13.873011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:13.881133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce84849b-55c5-4987-9f9e-83bc803d94c2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154855 Sep 13 14:26:13.881701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1034/2146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:13 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:14.387323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:14.389500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:14.396254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:14.396737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:14.397164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:14.397867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:14.398391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:14.398831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:14.430600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-90b36364-1f66-44e6-914c-83f36b5bd693 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047478 Sep 13 14:26:14.431156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1113/2147] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:14.904480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:14.905015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:14.906992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:26:14.907162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:26:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 (ip 10.222.0.20) !!! Sep 13 14:26:14.918845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:14.919318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:14.919746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:14.920424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:14.920868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:14.921279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:15.051891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:15.060656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f39e9440-afb7-48ff-b489-1972048cc8bd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.159964 Sep 13 14:26:15.061252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1035/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:14 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:15.443168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:15.445221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:15.447302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:26:15.447534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:26:15.454063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:15.454547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:15.454981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:15.455711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:15.456169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:15.456594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:15.488970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7b42a180-cc2d-4273-857c-a1bf16e30ffb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049861 Sep 13 14:26:15.489610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1114/2149] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:16.084285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:16.084895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:16.092067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:16.092539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:16.092971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:16.093649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:16.094201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:16.094619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:16.225920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:16.234198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb3650c3-d648-4eb9-be9f-104fb55035bc tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153699 Sep 13 14:26:16.234779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1036/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:16 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:16.501207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:16.503378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:16.509282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:16.510353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:16.510785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:16.511466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:16.511914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:16.512330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:16.547334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-16f67267-b26b-41c2-8c45-af35d9194811 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050022 Sep 13 14:26:16.547735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1115/2151] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:17.257224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:17.257857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:17.265016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:17.265487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:17.265955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:17.266632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:17.267081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:17.267499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:17.395616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:17.403872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4d18e1e-b3d1-46d7-8c2f-a03cd7802ba7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150474 Sep 13 14:26:17.404435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1037/2152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:17.561404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:17.563602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:17.569945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:17.570419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:17.570847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:17.571575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:17.571967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:17.572388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:17.601748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fb333b6c-515e-4d3a-b9b5-902e8359d026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Sep 13 14:26:17.602320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1116/2153] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:18.426707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:18.427309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:18.434494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:18.434970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:18.435399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:18.436083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:18.436529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:18.436952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:18.569092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:18.577264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0387e4b-15eb-4a22-a2cd-b3789c5072eb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154451 Sep 13 14:26:18.577845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1038/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:18.614438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:18.616658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:18.623888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:18.624366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:18.624793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:18.625462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:18.625942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:18.626359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:18.656132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eceb429f-b1e6-4198-8de7-09091d911137 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Sep 13 14:26:18.656688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1117/2155] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:19.600605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:19.601224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:19.607733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:19.608209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:19.608641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:19.609323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:19.609817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:19.610240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:19.668237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:19.670411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:19.676705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:19.677188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:19.677620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:19.678338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:19.678790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:19.679215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:19.711014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e462929d-05a2-4fcf-b1cb-03370b2e3cad tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047092 Sep 13 14:26:19.711704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1118/2156] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:19.738924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:19.742322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:19.748533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-500fec3d-d93c-4816-a1cc-0ffee123e1f2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151911 Sep 13 14:26:19.749099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1039/2157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:19 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:20.723489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:20.725631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:20.732673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:20.733157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:20.733596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:20.734316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:20.734782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:20.735212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:20.765950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c007890d-b277-4b72-ac90-a0615cb018a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Sep 13 14:26:20.766995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1119/2158] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:20.773284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:20.774437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:20.782065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:20.782550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:20.782985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:20.783679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:20.784134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:20.784561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:20.914948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:20.923020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1630e5ff-68a8-40c1-bcdf-af44df0e73b0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155328 Sep 13 14:26:20.923581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1040/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:20 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:21.778839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:21.780977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:21.787350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:21.787832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:21.788266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:21.788951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:21.789405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:21.789855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:21.819698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-43123079-00ae-4e47-bdef-613401d4ea3b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Sep 13 14:26:21.820253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1120/2160] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:21.946613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:21.947216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:21.954325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:21.954799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:21.955228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:21.955904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:21.956351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:21.956769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:22.085431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:22.093995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-74fbc367-ce0c-42ae-b200-f90f97ea601b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151146 Sep 13 14:26:22.094559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1041/2161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:21 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:22.832726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:22.834881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:22.841372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:22.841886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:22.842319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:22.842992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:22.843443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:22.843865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:22.873589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f6acf85a-46da-42a1-b9b1-cb3199690d15 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044678 Sep 13 14:26:22.874272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1121/2162] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:23.117426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:23.118067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:23.124788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:23.125213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:23.125644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:23.126357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:23.126807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:23.127243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:23.255034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:23.263378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e144c142-cb9b-4a0b-872c-6d4a532dbe9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149738 Sep 13 14:26:23.263953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1042/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:23 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:23.886723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:23.888886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:23.895603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:23.896077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:23.896506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:23.897190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:23.897640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:23.898088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:23.926871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0be9d61f-0712-4846-8673-1b366f4b5628 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 Sep 13 14:26:23.927350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1122/2164] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:24.286577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:24.287184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:24.294084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:24.294558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:24.294992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:24.295672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:24.296175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:24.296595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:24.427477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:24.436187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58ca78b4-5169-4764-a361-3265b110b83c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153307 Sep 13 14:26:24.436684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1043/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:24.939588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:24.941675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:24.948704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:24.949181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:24.949614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:24.950319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:24.950772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:24.951192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:24.981317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b8fc0ea-fe41-4a94-9f98-a7dfe6766f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 Sep 13 14:26:24.981883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1123/2166] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:25.459628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:25.460269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:25.467906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:25.468309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:25.468738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:25.469427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:25.469964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:25.470415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:25.600533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:25.609520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d2aaa07-295f-4d95-834f-66c188301dbf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153757 Sep 13 14:26:25.610114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1044/2167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:25 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:25.993508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:25.996517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:26.002788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:26.003259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:26.003683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:26.004356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:26.004804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:26.005219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:26.187983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-95e0a50c-9fc7-4d78-b3c7-06600914d32c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198331 Sep 13 14:26:26.188528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1124/2168] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:26.632231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:26.632848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:26.639189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:26.639666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:26.640093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:26.640782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:26.641222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:26.641869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:26.831532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:26.840600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff0672b7-6382-461b-8a90-280101627eae tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.212127 Sep 13 14:26:26.841262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1045/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:26 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:27.200665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:27.202836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:27.209015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:27.209484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:27.209946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:27.210617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:27.211063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:27.211488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:27.241642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d50c824-6d49-4881-b925-a64c3061608b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Sep 13 14:26:27.242216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1125/2170] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:27.864330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:27.864934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:27.872179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:27.872716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:27.873150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:27.873868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:27.874320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:27.874740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:28.005034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:28.013464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2db6dfe0-d3b8-4691-b117-2909cb541135 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152932 Sep 13 14:26:28.014062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1046/2171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:27 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:28.254584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:28.256709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:28.263237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:28.263716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:28.264170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:28.264850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:28.265305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:28.265749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:28.295002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7aaade2c-4cfc-4e55-b978-2b8aa583bd08 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Sep 13 14:26:28.295539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1126/2172] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:29.036195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:29.036802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:29.043710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:29.044178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:29.044609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:29.045282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:29.045751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:29.046168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:29.178237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:29.187216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ca373b6-0814-43b0-ba2a-6647aafbafc0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154869 Sep 13 14:26:29.187770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1047/2173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:29 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:29.306279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:29.309026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:29.315388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:29.316057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:29.316502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:29.317193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:29.317650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:29.318098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:29.321814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:29.348465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6d3c3838-924c-41ce-b3f5-83d202e461c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Sep 13 14:26:29.349158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1127/2174] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:30.210748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:30.211422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:30.218672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:30.219149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:30.219578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:30.220262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:30.220711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:30.221129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:30.348167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:30.356707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d835491-e143-4134-a6ab-cc1234d8dd80 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149749 Sep 13 14:26:30.357479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1048/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:30 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:26:30.360356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:30.362619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:30.368930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:30.369409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:30.369991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:30.370688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:30.371142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:30.371565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:30.400810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a6a00ee1-6c0b-4e41-9eb8-9cedece9ff72 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Sep 13 14:26:30.402006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1128/2176] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:31.379954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:31.380560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:31.387720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:31.388342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:31.388837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:31.389529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:31.390005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:31.390425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:31.413714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:31.415851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:31.422151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:31.422643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:31.423070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:31.423750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:31.424198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:31.424615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:31.455622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d61314f-d2ca-412d-9b5d-231558739dd5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045856 Sep 13 14:26:31.456408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1129/2177] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:31.522681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:31.531659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f781715d-5065-4add-bd97-dd968fb297fd tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155417 Sep 13 14:26:31.532233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1049/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:31 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:32.467689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:32.469842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:32.476325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:32.476815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:32.477254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:32.477981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:32.478439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:32.478861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:32.510783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7487edb4-f74f-48a7-8a93-c0c7d2775e6e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Sep 13 14:26:32.511330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1130/2179] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:32.554502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:32.555102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:32.562042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:32.562512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:32.562938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:32.563612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:32.564052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:32.564466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:32.692823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:32.701176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c67f671-b7e2-4558-ba2a-1693bd9e187f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150445 Sep 13 14:26:32.701898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1050/2180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:32 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:33.523724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:33.526142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:33.533468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:33.533986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:33.534416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:33.535099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:33.535548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:33.535965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:33.567288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22559756-3d6b-4cdb-916f-83cf2109723f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Sep 13 14:26:33.567833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1131/2181] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:33.724482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:33.725113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:33.731676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:33.732148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:33.732576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:33.733255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:33.733699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:33.734138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:33.863352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:33.872085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d61762fd-ae6c-42d2-8ff2-8e7625d64e16 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151737 Sep 13 14:26:33.872673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1051/2182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:33 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:34.579767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:34.581932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:34.588441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:34.588924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:34.589358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:34.590811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:34.591270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:34.591694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:34.620833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-93705002-9eaf-47e8-a5f2-e80f37be6a53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044995 Sep 13 14:26:34.621376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1132/2183] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:34.896462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:34.897064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:34.903942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:34.904424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:34.904862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:34.905589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:34.906081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:34.906511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:35.032028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:35.040173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2cf298d3-4df6-4a85-b9b2-756474dd8402 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147793 Sep 13 14:26:35.040742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1052/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:34 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:35.632433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:35.634664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:35.641755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:35.642297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:35.642735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:35.643425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:35.643887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:35.644317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:35.673953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-368162b7-0538-49e5-80ca-8cfe06884f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Sep 13 14:26:35.674507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1133/2185] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:36.064436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:36.065037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:36.071436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:36.071909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:36.072345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:36.073025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:36.073474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:36.074215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:36.203615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:36.211849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9696a5a5-473d-4189-8c2f-4c07712a3d2c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151983 Sep 13 14:26:36.212409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1053/2186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:36 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:36.687209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:36.689384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:36.695766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:36.696254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:36.696689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:36.697372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:36.697869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:36.698296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:36.728492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7c4584de-ec84-4525-ba85-99c0ad2bfd64 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Sep 13 14:26:36.729039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1134/2187] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:37.235029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:37.235634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:37.242076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:37.242546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:37.242972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:37.243640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:37.244083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:37.244509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:37.373054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:37.381197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a96ad2f-a495-46b0-924a-0786f3d2348a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150156 Sep 13 14:26:37.381771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1054/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:37 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:37.741577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:37.743748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:37.750743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:37.751226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:37.751660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:37.752340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:37.752796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:37.753220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:37.781941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78c24fa0-10e7-45f2-9166-68ad09f1ff96 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Sep 13 14:26:37.782488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1135/2189] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:38.404240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:38.404850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:38.411258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:38.411732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:38.412163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:38.412838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:38.413289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:38.413707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:38.545373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:38.553530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-79d5d1e3-ad5f-4aad-963e-58a8a4187fc9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153159 Sep 13 14:26:38.554133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1055/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:38 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:38.795507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:38.797684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:38.800038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=58 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:38.805497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:38.806008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:38.806438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:38.807114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:38.807583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:38.807980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:38.836435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b3716d0b-7fb1-44f9-bf7e-6d96f529918b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Sep 13 14:26:38.837008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1136/2191] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:39.578463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:39.579073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:39.585463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:39.585978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:39.586414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:39.587093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:39.587541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:39.587963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:39.605489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:39.717933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:39.726091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77814b41-0a66-44c4-abcc-29a56238ed43 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152172 Sep 13 14:26:39.726663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1056/2192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:39 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:39.849489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:39.851868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:39.858631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:39.859169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:39.859617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:39.860396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:39.860879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:39.861352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:39.891655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-80a7b896-51e5-4790-b5d6-8c30b63ec711 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046138 Sep 13 14:26:39.892208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1137/2193] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:40.749179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:40.749809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:40.752112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:40.757421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:40.757921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:40.758348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:40.759023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:40.759477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:40.759893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:40.886060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:40.895061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d2317ff1-a106-4bab-aeb2-90a6d22edab1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149621 Sep 13 14:26:40.895626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1057/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:40 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:40.904842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:40.907120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:40.917512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:40.918228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:40.918667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:40.919626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:40.920078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:40.920543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:40.949148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-26a9e36c-c980-4afd-8cac-a2bb64f9688f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048887 Sep 13 14:26:40.949694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1138/2195] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:41.920302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:41.920922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:41.927921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:41.928134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:41.928584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:41.929274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:41.930183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:41.933212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:41.962625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:41.967773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:41.975622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:41.976186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:41.976688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:41.977622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:41.978251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:41.978824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:42.011272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bbbbcda4-52a5-4ffb-9684-fccb1efe0d11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052850 Sep 13 14:26:42.012028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1139/2196] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:42.069410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:42.077750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2067767-cab8-4e05-8904-59d2650d3c89 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.162112 Sep 13 14:26:42.078321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1058/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:41 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:43.024310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:43.026496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:43.033246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:43.033755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:43.034194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:43.034886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:43.035344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:43.035769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:43.066241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b4b3df0a-f2e4-463b-a054-c022a6d4ca00 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 Sep 13 14:26:43.066800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1140/2198] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:43.101848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:43.102447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:43.109545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:43.110041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:43.110475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:43.111155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:43.111605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:43.112024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:43.241088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:43.249849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bed0b642-82a7-4f53-b1e7-b04c4aaadf04 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151828 Sep 13 14:26:43.250421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1059/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:43 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:44.082151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:44.084292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:44.090764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:44.091436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:44.092064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:44.092771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:44.093229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:44.093655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:44.125652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e37f280c-29db-4da9-9348-dec4f54c4e24 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047404 Sep 13 14:26:44.126253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1141/2200] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:44.274055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:44.274665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:44.284257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:44.284743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:44.285178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:44.285909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:44.286359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:44.286775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:44.430413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:44.440007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43c1c705-8317-4d61-ace9-12d39d17f339 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.170004 Sep 13 14:26:44.441551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1060/2201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:44 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:45.139031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:45.141145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:45.147749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:45.148259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:45.148688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:45.149379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:45.149851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:45.150275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:45.181892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c36774ba-c0f3-4bf1-af54-40618a834232 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 Sep 13 14:26:45.182464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1142/2202] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:45.465686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:45.466321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:45.472711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:45.473180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:45.473604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:45.474309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:45.474750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:45.475331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:45.608700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:45.616822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-80e5b0c3-36ad-4a9f-8151-2783ffc78fc1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154964 Sep 13 14:26:45.617319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1061/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:45 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:46.195134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:46.197308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:46.203864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:46.204251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:46.204691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:46.205457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:46.205944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:46.206401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:46.232498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:46.238150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-645c1960-5faa-4b6d-8371-5d1d692fbf7e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047219 Sep 13 14:26:46.238705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1143/2204] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:46.640236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:46.640875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:46.647646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:46.648123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:46.648555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:46.649233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:46.649680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:46.650194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:46.776871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:46.785041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bb47b79-4e4b-47e8-99e7-1e1ce31dbab5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149487 Sep 13 14:26:46.785600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1062/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:46 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:47.250845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:47.253002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:47.259331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:47.259826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:47.260265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:47.260956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:47.261418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:47.261882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:47.291563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-acbceb25-d7da-4449-b871-9f72d75ee3dc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Sep 13 14:26:47.292107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1144/2206] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:47.808595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:47.809204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:47.816252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:47.816731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:47.817163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:47.817873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:47.818334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:47.818755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:47.946116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:47.954954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c2c3ff8-a675-4df7-b701-bb310bbb1815 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150204 Sep 13 14:26:47.955524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1063/2207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:47 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:48.304312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:48.306540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:48.313535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:48.314040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:48.314479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:48.315166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:48.315619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:48.316044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:48.345515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e504f56-4e7a-4d07-a3da-19507a14f9ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Sep 13 14:26:48.346118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1145/2208] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:48.978098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:48.978707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:48.985217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:48.985688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:48.986147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:48.986832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:48.987287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:48.987711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:49.124113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:49.132224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bfe9005-3a58-494f-9531-55041e7b7a9d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157927 Sep 13 14:26:49.132787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1064/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:48 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:49.358196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:49.360324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:49.366648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:49.367129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:49.367563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:49.368248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:49.368706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:49.369129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:49.399409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1f2f4c51-5f91-434f-a952-824ff104b16b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Sep 13 14:26:49.399959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1146/2210] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:50.156807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:50.157432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:50.163817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:50.164297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:50.164733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:50.165420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:50.165897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:50.166324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:50.292981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:50.302072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7dc11a2b-5fc7-449a-86ce-2f736e95116e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149908 Sep 13 14:26:50.302645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1065/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:50 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:50.412103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:50.414601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:50.421407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:50.421917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:50.422351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:50.423182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:50.423638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:50.424067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:50.454522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b729cc9d-45ae-4a1a-85e1-47db28889a37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046353 Sep 13 14:26:50.455072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1147/2212] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:51.325358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:51.325997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:51.332888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:51.333354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:51.333800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:51.334475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:51.334917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:51.335330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:51.463810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:51.466801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:51.469687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:51.473713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9792f66d-f835-4c86-b4ab-be5d28aff470 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152165 Sep 13 14:26:51.474331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1066/2213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:51 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:51.476102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:51.476596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:51.477031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:51.477742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:51.478204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:51.478627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:51.509430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-deaaa5b6-67b5-4ce3-b229-68c93dca41ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046485 Sep 13 14:26:51.510013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1148/2214] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:52.497771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:52.499015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:52.505551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:52.506067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:52.506494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:52.507166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:52.507618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:52.508029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:52.522377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:52.525785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:52.536223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:52.536720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:52.537155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:52.537900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:52.538552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:52.538976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:52.572142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1c5d3098-7d79-4441-b8c3-0475b8cb602e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054153 Sep 13 14:26:52.572705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1149/2215] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:26:52.640130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:52.648375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-82345a03-0d3f-4538-a65e-b2ee49e8185e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154468 Sep 13 14:26:52.648941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1067/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:52 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:53.585145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:53.587301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:53.594687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:53.595184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:53.595623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:53.596326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:53.596787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:53.597212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:53.627220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1f55687c-42fe-42c7-874e-0a2dfd99c15e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 Sep 13 14:26:53.627877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1150/2217] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:53.671639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:53.672230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:53.678092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:53.678568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:53.678991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:53.679660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:53.680105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:53.680514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:53.810649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:53.819730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-944dcfcf-29c3-429c-ae5d-9acb20d1813c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152002 Sep 13 14:26:53.820406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1068/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:53 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:54.639970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:54.642160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:54.648907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:54.649391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:54.649925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:54.650615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:54.651070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:54.651495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:54.682961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e4d326c-ae97-4ec8-b083-1afc46325c34 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Sep 13 14:26:54.687828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1151/2219] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:54.844036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:54.844653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:54.851340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:54.851756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:54.852193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:54.852884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:54.853342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:54.853786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:54.979368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:54.987497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b288c355-8774-4935-be3c-12410d3af5a0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147928 Sep 13 14:26:54.988067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1069/2220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:54 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:55.695651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:55.697914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:55.704371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:55.704784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:55.705220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:55.705945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:55.706404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:55.707066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:55.738596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f787761-9974-4f66-9d5c-88a39750212f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Sep 13 14:26:55.739198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1152/2221] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:56.009665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:56.010309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:56.020711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:56.022067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:56.022508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:56.023209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:56.023695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:56.024126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:56.156961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:56.165113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-baff2c19-6c6e-41ac-ac57-4b02037c5227 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.159340 Sep 13 14:26:56.165685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1070/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:56 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:56.751682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:56.753838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:56.760233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:56.760711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:56.761146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:56.761850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:56.762304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:56.762730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:56.793618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bd81866b-e65b-4c36-bb34-f07a5e3d5648 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Sep 13 14:26:56.794206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1153/2223] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:57.189161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:57.189709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:57.196141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:57.196617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:57.197048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:57.197753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:57.198202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:57.198623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:57.325484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:57.334625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8270c1e5-a5c7-4b10-bc7a-7902a448488b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149501 Sep 13 14:26:57.335190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1071/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:57 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:57.807748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:57.809826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:57.817104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:57.817585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:57.820041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:57.826246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:57.827383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:57.827830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:57.860262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d532ec2-8544-43a9-a3ab-1fb7514f7fbf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057759 Sep 13 14:26:57.860844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1154/2225] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:58.360583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:58.361204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:58.367375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:58.367802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:58.368232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:58.368914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:58.369368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:58.369805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:58.499588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:58.507675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45a65182-766d-4449-af3f-c61cdf98870c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152768 Sep 13 14:26:58.508230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1072/2226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:58.872682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:58.874935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:58.881241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:58.881700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:58.882161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:58.882833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:58.883280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:58.883697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:58.914363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af6ec93a-e511-49db-9e82-a77f0790ec53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045658 Sep 13 14:26:58.915191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1155/2227] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:26:59.531303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:59.531917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:59.538645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:59.539144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:59.539576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:59.540279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:59.540793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:59.541214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:59.545981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:26:59.674977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:26:59.683435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8684488-220a-4bcf-aef8-f79984ad1a65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.156123 Sep 13 14:26:59.684006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1073/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:26:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:26:59.927339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:26:59.929411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:26:59.935992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:59.936480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:59.936920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:59.937613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:26:59.938107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:26:59.938532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:26:59.968159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8dbacf86-d45a-461b-82b3-312dcb806cea tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Sep 13 14:26:59.968721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1156/2229] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:26:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:00.708060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:00.708711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:00.715696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:00.716100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:00.716545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:00.717451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:00.717685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:00.718255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:00.847887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:00.856085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-836f9a1f-9f22-4877-9d91-101c03cef200 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152018 Sep 13 14:27:00.856658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1074/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:00 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:00.980441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:00.982664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:00.989453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:00.989971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:00.990405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:00.991088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:00.991577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:00.992003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:01.023076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-332dc8c2-8637-4b7f-9f18-ec63fff6499d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046537 Sep 13 14:27:01.023646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1157/2231] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:01.879747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:01.880353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:01.886753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:01.887225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:01.887654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:01.888330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:01.888779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:01.889195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:02.019538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:02.027929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36e21c8f-ca97-4c79-a606-55463b7b259d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152022 Sep 13 14:27:02.028491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1075/2232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:01 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:27:02.035608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:02.037774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:02.044084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:02.044562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:02.045025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:02.045705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:02.046362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:02.047269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:02.076942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0963744a-49c8-4376-ac7d-7d2900548b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Sep 13 14:27:02.078144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1158/2233] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:03.051890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:03.052488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:03.059002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:03.059483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:03.059900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:03.060572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:03.061014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:03.061430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:03.089375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:03.091474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:03.098622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:03.099112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:03.099565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:03.100238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:03.100695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:03.101121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:03.131867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa915b8b-83c3-40de-a5c3-6c93ab4ee929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046419 Sep 13 14:27:03.132760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1159/2234] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:03.192580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:03.200666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86f6abb3-07d8-46fd-bef3-4ab21aa27f4e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152600 Sep 13 14:27:03.201234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1076/2235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:04.144403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:04.146782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:04.153084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:04.153568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:04.154110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:04.154796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:04.155254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:04.155744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:04.172680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:04.186152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28bab616-4278-4561-99f1-e4501672bea4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045801 Sep 13 14:27:04.187591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1160/2236] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:04.224811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:04.225431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:04.232353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:04.232827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:04.233378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:04.234682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:04.235129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:04.235549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:04.361657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:04.369931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1710ca20-e599-4bc0-9e2e-73895277b03d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148870 Sep 13 14:27:04.370696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1077/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:05.198740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:05.200929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:05.208112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:05.208589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:05.209020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:05.209751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:05.210206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:05.210629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:05.239227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee0102c3-e12d-4a6d-87da-211edadc22a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044560 Sep 13 14:27:05.239797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1161/2238] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:05.393500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:05.394164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:05.400833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:05.401314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:05.401769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:05.402460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:05.402916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:05.403346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:05.533444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:05.541577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e7d1818-4531-4a64-a8df-de8e1682d68f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151943 Sep 13 14:27:05.542160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1078/2239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:06.251933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:06.254111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:06.261219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:06.261751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:06.262198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:06.262880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:06.263339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:06.263764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:06.292567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c64bf09-ae14-4597-b703-255a44b06feb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Sep 13 14:27:06.293048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1162/2240] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:06.564365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:06.564913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:06.571341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:06.571815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:06.572246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:06.572927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:06.573377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:06.573822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:06.698437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:06.706821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1097f72f-2e98-452d-afbd-1714d5fd2cd0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146388 Sep 13 14:27:06.707383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1079/2241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:06 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:07.305009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:07.307170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:07.314028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:07.314497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:07.314921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:07.315595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:07.316042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:07.316456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:07.345532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f91b16b5-fad8-420b-a75e-2e1cf84039a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Sep 13 14:27:07.346031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1163/2242] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:07.730023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:07.730634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:07.737607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:07.738185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:07.738621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:07.739305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:07.739758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:07.740177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:07.870159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:07.879173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3935b71f-ad41-4c0e-8bd1-c29343f36703 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152906 Sep 13 14:27:07.879738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1080/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:08.357770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:08.359822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:08.366859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:08.367897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:08.368335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:08.369014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:08.369464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:08.369922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:08.400984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65e4d347-2b24-48b7-b3af-4860c52530dd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Sep 13 14:27:08.401538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1164/2244] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:08.903263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:08.903803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:08.910776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:08.911247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:08.911672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:08.912379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:08.912822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:08.913237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:09.040701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:09.050029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7122df96-650a-4916-9148-2c441d3d5ef6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150703 Sep 13 14:27:09.050594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1081/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:08 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:09.414061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:09.416153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:09.418472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=58 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:09.423668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:09.424147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:09.424581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:09.425267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:09.425718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:09.426163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:09.456278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-90678d57-fd01-496f-ba7b-3707bf2c9edf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Sep 13 14:27:09.456823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1165/2246] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:10.073485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:10.074132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:10.080527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:10.081003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:10.081438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:10.082165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:10.082616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:10.083229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:10.212102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:10.220983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2092870b-8cf1-482a-8716-8e91a43e8421 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151233 Sep 13 14:27:10.221556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1082/2247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:10.468509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:10.470752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:10.477061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:10.477545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:10.478000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:10.478674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:10.479120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:10.479535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:10.509516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e5ed13a1-9348-49ee-8c78-77cb2d9ce61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044843 Sep 13 14:27:10.510025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1166/2248] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:11.244251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:11.244990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:11.247324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:11.253298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:11.253797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:11.254233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:11.254951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:11.255399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:11.255819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:11.385210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:11.393382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c45dca69-2946-4118-8339-14462e70d373 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153030 Sep 13 14:27:11.393976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1083/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:11.522217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:11.524375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:11.530991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:11.531474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:11.531990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:11.532728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:11.533187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:11.533609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:11.563009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f70ffa3-9191-4484-bed4-4a11aec65831 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Sep 13 14:27:11.564425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1167/2250] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:12.417053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:12.417571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:12.424219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:12.424686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:12.425114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:12.425816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:12.426262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:12.426682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:12.556173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:12.564868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e2462981-0bfa-4caf-b478-ef75f9df906d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151628 Sep 13 14:27:12.565420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1084/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:12.576250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:12.578451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:12.586196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:12.586686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:12.587120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:12.587813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:12.588272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:12.588700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:12.618086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4a59852-711a-4680-80c3-835e02579004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 Sep 13 14:27:12.618653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1168/2252] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:13.589434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:13.590092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:13.597279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:13.597770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:13.598202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:13.598873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:13.599318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:13.599767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:13.630378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:13.632512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:13.638864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:13.639344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:13.639772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:13.640459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:13.640912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:13.641915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:13.672469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05042991-320e-4474-8f02-3a35775eaf0d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Sep 13 14:27:13.673042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1169/2253] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:13.731270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:13.739237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf93a96b-ec60-402d-9bfe-fec58ad8bda0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153546 Sep 13 14:27:13.739818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1085/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:13 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:14.685469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:14.687692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:14.695271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:14.695683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:14.696112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:14.696794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:14.697243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:14.697663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:14.726923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-971a63e1-4c3a-4e45-a2c1-9d74142a6237 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Sep 13 14:27:14.727493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1170/2255] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:14.762406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:14.763046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:14.769628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:14.770390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:14.770823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:14.771509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:14.771958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:14.772378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:14.900532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:14.908747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c490038d-a322-4ff7-88bd-7b58642c7645 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150021 Sep 13 14:27:14.909311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1086/2256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:14 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:15.739175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:15.741345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:15.747887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:15.748359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:15.748790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:15.749466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:15.749942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:15.750360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:15.780723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e521977d-3d66-448d-b6f6-7ac4ff974eb1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Sep 13 14:27:15.781263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1171/2257] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:15.931695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:15.932298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:15.938674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:15.939144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:15.940293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:15.941050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:15.941499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:15.941948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:16.079772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:16.088567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16c26e2b-6ce9-4f3e-a64b-5e3740a0d14a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.160608 Sep 13 14:27:16.089132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1087/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:15 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:16.793345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:16.795523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:16.801963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:16.802441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:16.802872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:16.803546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:16.803996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:16.804412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:16.833618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-15457601-d449-4228-b94e-13626fefa8a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Sep 13 14:27:16.834186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1172/2259] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:17.112074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:17.112674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:17.119089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:17.119584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:17.119992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:17.120671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:17.121124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:17.121543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:17.246772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:17.255434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ed8c84c-22a0-44fa-94d6-43e4c410cd65 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147188 Sep 13 14:27:17.256008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1088/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:17.846565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:17.848721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:17.855113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:17.855595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:17.856061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:17.856745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:17.857196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:17.857628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:17.886865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-287e1298-f048-480d-8606-2978016e9303 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Sep 13 14:27:17.887412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1173/2261] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:18.279121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:18.279724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:18.286826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:18.287299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:18.287724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:18.288397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:18.288843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:18.289260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:18.415747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:18.419161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:18.424754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e980a5fd-813e-4fa6-9a73-e0e04aead5fe tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149294 Sep 13 14:27:18.425320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1089/2262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:18.899491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:18.901647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:18.907980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:18.908691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:18.909154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:18.909871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:18.910361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:18.910781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:18.940112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-13113333-c187-485a-9100-1643f3a2d48c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Sep 13 14:27:18.940645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1174/2263] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:19.448714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:19.449331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:19.455731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:19.456208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:19.456645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:19.457330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:19.457817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:19.458244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:19.590062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:19.598931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d099d677-88b1-4619-a35a-44c0ca08c0a1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154438 Sep 13 14:27:19.599497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1090/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:19 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:19.952213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:19.954382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:19.961622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:19.962130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:19.962561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:19.963241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:19.963694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:19.964106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:19.992253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a5456b1-62d4-462c-be3b-a3aa2d96020e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 Sep 13 14:27:19.992787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1175/2265] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:20.621738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:20.622352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:20.629478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:20.629998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:20.630433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:20.631140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:20.631593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:20.632016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:20.759652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:20.767689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48126b7b-887b-4a74-9d9a-ef683f0a4316 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149725 Sep 13 14:27:20.768251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1091/2266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:20 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:21.004471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:21.006570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:21.012899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:21.013370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:21.013825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:21.014500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:21.014946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:21.015366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:21.045012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4c4befb5-d010-4e52-9baf-b5f80fd6d801 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Sep 13 14:27:21.045562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1176/2267] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:21.791706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:21.792320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:21.798775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:21.799577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:21.800029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:21.800717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:21.801172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:21.801597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:21.929291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:21.937438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc9e8258-75a1-4654-9484-378a06215dca tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149533 Sep 13 14:27:21.938046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1092/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:21 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:22.057046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:22.059220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:22.066271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:22.066756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:22.067194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:22.067885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:22.068345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:22.068774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:22.072403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:22.100642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8663cb8e-50e5-4cdd-bb1e-8d4aaab1b404 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Sep 13 14:27:22.101433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1177/2269] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:22.960808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:22.961410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:22.967776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:22.968248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:22.968679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:22.969355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:22.969822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:22.970295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:23.096875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:23.104981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23f7ce81-1fde-4ba3-aa6c-64364e8ff9f3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147991 Sep 13 14:27:23.105546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1093/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:22 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:23.113006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:23.115163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:23.121383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:23.121910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:23.122330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:23.123000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:23.123450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:23.123867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:23.152233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6f0d1ee0-b62e-4115-a802-21b182945514 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043797 Sep 13 14:27:23.152771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1178/2271] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:24.129182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:24.129827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:24.136039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:24.136516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:24.136947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:24.137656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:24.138146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:24.138549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:24.271443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:24.279954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9ca91389-dfbd-4159-9e47-790aa6f989e9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155260 Sep 13 14:27:24.280522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1094/2272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:27:24.282650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:24.285561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:24.292051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:24.292487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:24.292912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:24.293593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:24.294067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:24.294689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:24.323979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-163c5db3-3416-4880-aa73-4a668074ea25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162730 Sep 13 14:27:24.324537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1179/2273] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:25.304863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:25.305473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:25.311854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:25.312382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:25.312811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:25.313483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:25.313966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:25.314564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:25.336338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:25.338595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:25.346766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:25.347264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:25.347702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:25.348402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:25.348867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:25.349291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:25.382717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5cc95a1c-45df-4177-adb0-89b6c6f2fb8b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Sep 13 14:27:25.383972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1180/2274] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:25.689891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:25.697988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c416566-48d6-4525-ac6c-db9cd21bf3d2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.396929 Sep 13 14:27:25.698548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1095/2275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:25 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:27:26.396357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:26.398562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:26.404961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:26.405439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:26.405912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:26.406625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:26.407077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:26.407495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:26.438279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53a5fd02-ce84-4510-8f4c-983950441fab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Sep 13 14:27:26.438863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1181/2276] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:26.836243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:26.836853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:26.842782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:26.843252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:26.843679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:26.844356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:26.844802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:26.845221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:26.971895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:26.980132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1219a424-75de-4e03-a5c1-453211ed7209 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.262568 Sep 13 14:27:26.990243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1096/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:26 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:27.451093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:27.453277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:27.460383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:27.460856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:27.461286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:27.462055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:27.462574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:27.462997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:27.494326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e49cb16a-c529-4ff7-b5bd-102601b8d8cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047084 Sep 13 14:27:27.499132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1182/2278] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:28.003796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:28.004529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:28.012097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:28.012871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:28.013431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:28.014242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:28.014765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:28.015259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:28.158674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:28.166716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-975f16f8-9461-4ab7-b5e9-f0161782dd58 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.166810 Sep 13 14:27:28.167293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1097/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:27 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:28.507066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:28.509246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:28.515784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:28.516272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:28.516707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:28.518088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:28.518634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:28.519087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:28.555206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a8f2fc66-4e15-4f0a-b5f9-827be8d6d94b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052013 Sep 13 14:27:28.556836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1183/2280] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:29.189861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:29.190477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:29.196888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:29.197359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:29.197818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:29.198501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:29.198951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:29.199372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:29.331088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:29.339724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51e1f275-3362-4b39-bb6f-8e11a0687de0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153908 Sep 13 14:27:29.340283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1098/2281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:29 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:29.568576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:29.570774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:29.577076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:29.577557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:29.578075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:29.578711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:29.579163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:29.579586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:29.609805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-256f7c37-3bdd-46f6-b844-2a3d958065ba tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Sep 13 14:27:29.610362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1184/2282] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:30.362945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:30.363481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:30.369947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:30.370423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:30.370855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:30.371537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:30.371993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:30.372413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:30.508042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:30.516292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23b94a7b-f64f-429c-87cd-f9b5801f34b9 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157706 Sep 13 14:27:30.516893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1099/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:30 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:30.621722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:30.623806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:30.630441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:30.630915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:30.631344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:30.632020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:30.632466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:30.632882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:30.662363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e45b478-f1b3-4522-896f-69c4b80afd3f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Sep 13 14:27:30.662964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1185/2284] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:31.539181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:31.539812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:31.546187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:31.546654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:31.547085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:31.547757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:31.548203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:31.549144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:31.675476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:31.677801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:31.679106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:31.684301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:31.684787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:31.685220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:31.685946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:31.686406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:31.686857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:31.687614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86846277-7b7c-4c8e-b818-c5da25e5f0bf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152311 Sep 13 14:27:31.688192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1100/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:31 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:31.716958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83d4fbe2-9393-4b7b-a1e6-e2697892557b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046161 Sep 13 14:27:31.717512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1186/2286] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:32.711794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:32.712534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:32.719013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:32.719497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:32.719926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:32.720874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:32.721326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:32.721769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:32.736385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:32.738739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:32.744976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:32.745455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:32.745911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:32.746597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:32.747046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:32.747466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:32.779591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82832837-ab18-4a71-b72e-2b3235472fc7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046708 Sep 13 14:27:32.783920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1187/2287] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:32.853835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:32.861892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7666861e-e0ce-4a58-86da-4a2bb42658b7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153926 Sep 13 14:27:32.862446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1101/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:32 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:33.791558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:33.793642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:33.800413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:33.800900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:33.801341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:33.802089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:33.802551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:33.802980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:33.836178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dbdc9394-ed44-440b-bca3-e4a8b7c63858 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 Sep 13 14:27:33.836740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1188/2289] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:33.885501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:33.886141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:33.888583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:27:33.888711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:27:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 (ip 10.222.0.20) !!! Sep 13 14:27:33.895409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:33.895879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:33.896308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:33.896996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:33.897455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:33.897908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:34.026710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:34.036694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8cbf589a-15e1-4cb3-aabd-76c3bf37e376 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154900 Sep 13 14:27:34.037277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1102/2290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:33 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:34.847774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:34.849969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:34.856580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:34.857066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:34.857502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:34.858224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:34.858688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:34.859112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:34.889745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f4cf53eb-f36b-4638-9deb-1517e702e15c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Sep 13 14:27:34.890307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1189/2291] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:35.059970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:35.060748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:35.067854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:35.068337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:35.068768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:35.069493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:35.069979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:35.070433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:35.201373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:35.209600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54e638e4-2881-43b3-b736-4ef2dadd0c6c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153478 Sep 13 14:27:35.210203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1103/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:35 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:35.902294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:35.904501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:35.910865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:35.911347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:35.911780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:35.912465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:35.912918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:35.913340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:35.942468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1eb9d32c-300d-4d34-baee-9656686f0580 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Sep 13 14:27:35.943006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1190/2293] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:36.233289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:36.233851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:36.240999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:36.241480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:36.241999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:36.242741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:36.243196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:36.243624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:36.369659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:36.378431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47b7f05d-2b3e-4410-ac9e-a966f1b77ec0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148934 Sep 13 14:27:36.379003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1104/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:36 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:36.954701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:36.957035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:36.959151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:27:36.959298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:27:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:27:36.965167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:36.965651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:36.966109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:36.966796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:36.967249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:36.967674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:36.999381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7f1ed35b-0e48-4619-abf6-68be8ade6b25 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048536 Sep 13 14:27:36.999960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1191/2295] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:37.402925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:37.403469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:37.410372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:37.410837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:37.411263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:37.411933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:37.412375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:37.412788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:37.543648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:37.551883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad75722c-abc0-428d-919e-2b45bce1be01 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152851 Sep 13 14:27:37.552454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1105/2296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:37 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:38.012018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:38.014237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:38.021666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:38.022172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:38.022603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:38.023285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:38.023739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:38.024160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:38.052796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10962854-5038-486e-9e67-119fe7bc4bf1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Sep 13 14:27:38.053346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1192/2297] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:38.574481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:38.575083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:38.581583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:38.582091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:38.582513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:38.583189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:38.583635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:38.584056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:38.601983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:38.715220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:38.724055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-629cca9f-c3db-416e-98d8-17d8393b9f92 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153414 Sep 13 14:27:38.724611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1106/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:38 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:39.064401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:39.066708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:39.073041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:39.073523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:39.073987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:39.074673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:39.075126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:39.075549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:39.101270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:39.106757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-22c7f53f-b815-46d9-89f9-fd5cda27aaa0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Sep 13 14:27:39.107319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1193/2299] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:39.747386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:39.747992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:39.755113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:39.755595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:39.756006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:39.756683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:39.757127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:39.757541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:39.883320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:39.891434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14da6eca-7d1f-4c6f-ba77-a812ff4646ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147787 Sep 13 14:27:39.891992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1107/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:39 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:40.119413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:40.121473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:40.123805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=58 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:40.129552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:40.130050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:40.130480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:40.131157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:40.131606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:40.132024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:40.161043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-27f8fcec-6575-4cc8-8f70-ce29598500fa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045896 Sep 13 14:27:40.161584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1194/2301] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:40.914953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:40.915588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:40.922061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:40.922537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:40.922967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:40.923644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:40.924285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:40.924533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:41.057584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:41.066510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76f0d9da-b218-4a71-aa1e-be290aa7f479 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155340 Sep 13 14:27:41.067070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1108/2302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:40 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:41.173228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:41.175492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:41.181967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:41.182447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:41.182879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:41.183559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:41.184014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:41.184434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:41.213945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e06c77d8-1cf6-4af3-b07f-1ffdd383727e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Sep 13 14:27:41.214492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1195/2303] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:42.090119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:42.090728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:42.094075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=52 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:42.098962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:42.099437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:42.106856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:42.106856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:42.106856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:42.106856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:42.226672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:42.226944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:42.229186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:42.234771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ad6cc12-e428-407c-b622-272a4a92399f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149285 Sep 13 14:27:42.235327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1109/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:42 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:42.235485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:42.235943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:42.236372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:42.237214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:42.237666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:42.238113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:42.267186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18ea95de-fc55-43c2-a333-b3d2fdc2833b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Sep 13 14:27:42.267741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1196/2305] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:43.257953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:43.258615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:43.265137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:43.265633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:43.266093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:43.266771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:43.267217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:43.267635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:43.280112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:43.282313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:43.289106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:43.289589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:43.290051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:43.290738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:43.291190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:43.291611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:43.322912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-00ffe45b-9a69-4ddb-957a-a9bfeab872d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046628 Sep 13 14:27:43.323485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1197/2306] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:43.401239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:43.409778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96feb3da-9000-4f36-92fb-81de07bfa79e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155518 Sep 13 14:27:43.410334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1110/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:43 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:44.335716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:44.337917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:44.344378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:44.344917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:44.345377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:44.346815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:44.347268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:44.347689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:44.376484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-04ec3591-6700-44c6-9a9b-b19593b169db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044736 Sep 13 14:27:44.377064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1198/2308] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:44.433105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:44.434101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:44.440786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:44.441336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:44.441818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:44.442470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:44.442914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:44.443328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:44.575087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:44.584109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6718e276-2f31-47ef-a0f5-712f86ba1abf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155498 Sep 13 14:27:44.584689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1111/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:44 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:45.388654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:45.390857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:45.397459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:45.397970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:45.398401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:45.399079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:45.399529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:45.399947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:45.430164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed9521aa-3821-4eda-8ece-2fb13898dfda tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Sep 13 14:27:45.430552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1199/2310] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:45.608253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:45.608861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:45.616071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:45.616544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:45.616973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:45.617652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:45.618141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:45.618562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:45.747460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:45.755739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-67566bfe-2520-4a14-8367-2f36a023796e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151278 Sep 13 14:27:45.756234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1112/2311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:45 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:46.443349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:46.445534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:46.451802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:46.452286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:46.452721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:46.453415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:46.453906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:46.454332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:46.490921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-62d78fd5-1924-40b6-b530-ac7e7deed584 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052272 Sep 13 14:27:46.491494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1200/2312] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:46.779481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:46.780119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:46.786832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:46.787310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:46.787739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:46.788424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:46.788866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:46.789281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:46.942649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:46.950855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d386b6a3-1103-4e10-b3ee-b8dc8354a675 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.175215 Sep 13 14:27:46.951419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1113/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:46 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:47.504772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:47.506959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:47.513374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:47.513890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:47.514320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:47.514993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:47.515441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:47.515859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:47.547641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d145e9d1-8482-4c10-b657-293bd1554678 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047086 Sep 13 14:27:47.548201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1201/2314] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:47.973962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:47.974571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:47.980867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:47.981335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:47.981793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:47.982470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:47.982915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:47.983328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:48.108110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:48.116627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-240bc567-2dc9-4a8c-895d-dca3d795f83b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146736 Sep 13 14:27:48.117179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1114/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:47 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:48.560035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:48.562212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:48.569332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:48.569915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:48.570354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:48.571037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:48.571492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:48.571913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:48.601134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4af58c83-369b-449b-897e-1687e744c4ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Sep 13 14:27:48.601684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1202/2316] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:49.140232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:49.140837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:49.147617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:49.148088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:49.148516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:49.149194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:49.149642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:49.150089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:49.281096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:49.289815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb63c459-7ced-4983-8df4-46a118f4fc7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153413 Sep 13 14:27:49.290457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1115/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:49 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:49.613610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:49.615950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:49.622383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:49.622858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:49.623287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:49.623969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:49.624424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:49.624851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:49.654172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bdca736f-05f5-48d1-8681-e0614c2e3c82 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Sep 13 14:27:49.654723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1203/2318] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:50.319975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:50.320615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:50.327055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:50.327529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:50.327963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:50.328646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:50.329096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:50.329515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:50.461523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:50.470485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6680d1a8-27a6-431b-aa50-72992faf4a4d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154275 Sep 13 14:27:50.471104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1116/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:50 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:50.667083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:50.671586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:50.678771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:50.679246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:50.679677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:50.680512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:50.680972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:50.681391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:50.710177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee6a5ce0-9931-40e6-ba20-e8dd168c354b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047008 Sep 13 14:27:50.710732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1204/2320] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:51.493709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:51.494264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:51.500598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:51.501067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:51.501512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:51.502733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:51.503278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:51.503696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:51.633048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:51.641301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49f8ea66-a135-41b9-9989-2373b7811245 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151440 Sep 13 14:27:51.641890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1117/2321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:51 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:51.722545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:51.724715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:51.731050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:51.731523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:51.731950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:51.732623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:51.733069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:51.733482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:51.762816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d75a674e-50da-48b3-b1ae-4ac5f0b3dd49 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Sep 13 14:27:51.763292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1205/2322] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:52.665400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:52.666718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:52.673059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:52.673539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:52.674357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:52.675168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:52.675615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:52.676223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:52.775793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:52.778109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:52.785074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:52.785552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:52.786011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:52.786703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:52.787181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:52.787593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:52.804068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:52.812016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b4f65b5-4956-4997-bc33-d805b4151433 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150385 Sep 13 14:27:52.812582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1118/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:52 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:52.817467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-80d99341-f481-4334-b5b5-4a38808fd2da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Sep 13 14:27:52.818067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1206/2324] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:27:53.829816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:53.832977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:53.836054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:53.836667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:53.839347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:53.839831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:53.840264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:53.840973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:53.841428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:53.841882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:53.842975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:53.843490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:53.843929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:53.844613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:53.845071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:53.845494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:53.870559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efa65754-d05b-4857-a4f3-eaa4565ee512 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 Sep 13 14:27:53.871120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1119/2325] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:53.976038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:53.984166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bcfc69df-e571-4999-b1d8-2e017da8309d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151852 Sep 13 14:27:53.984728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1207/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:53 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:54.883851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:54.886210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:54.892639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:54.893112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:54.893547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:54.894251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:54.894699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:54.895117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:54.914242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:27:54.914448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:27:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments (ip 10.222.0.20) !!! Sep 13 14:27:54.927575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7a64e313-37f3-45ab-bb2a-3fda1e420f87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048066 Sep 13 14:27:54.928126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1120/2327] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:55.009139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:55.009758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:55.016243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:55.016716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:55.017141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:55.017938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:55.018556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:55.018978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:55.145022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:55.153306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6a83c71c-0ca0-4c39-9f72-c1958bca57a3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148778 Sep 13 14:27:55.153886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1208/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:55 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:55.939818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:55.942021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:55.948767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:55.949249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:55.949682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:55.950386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:55.950840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:55.951263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:55.982504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d41fc1ed-d916-4086-9818-a29fdf01d6fc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046602 Sep 13 14:27:55.983049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1121/2329] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:56.177448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:56.178078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:56.184628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:56.185102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:56.185529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:56.186235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:56.186684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:56.187101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:56.318506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:56.326653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e2760747-3409-4e47-8a63-fb6346f79ef2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153605 Sep 13 14:27:56.327161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1209/2330] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:56 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:56.995877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:56.998158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:57.005501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:57.005996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:57.006420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:57.007094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:57.007538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:57.007953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:57.183418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0257fd40-ed11-4e31-9fc8-07dfbcbb4ffd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191352 Sep 13 14:27:57.183992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1122/2331] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:57.351141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:57.351753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:57.358294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:57.358780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:57.359217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:57.359901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:57.360357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:57.360784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:57.380079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:57.489891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:57.498064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1585200d-61e7-4dc7-ac9d-1c52ad09b5d1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150849 Sep 13 14:27:57.498633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1210/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:57 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:58.194861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:58.196967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:58.203252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:58.203724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:58.204153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:58.204832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:58.205420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:58.205904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:58.209480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:27:58.235849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9085de5a-4f00-4a67-95ea-863c2d4a9252 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Sep 13 14:27:58.237021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1123/2333] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:58.527573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:58.527992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:58.534804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:58.535276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:58.535706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:58.536444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:58.536888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:58.537302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:58.663476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:58.671505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8f3760ef-1e0b-41d0-b827-9ed2b3e1e2cb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148436 Sep 13 14:27:58.672058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1211/2334] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:27:59.248671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:59.250828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:59.262361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:59.262361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:59.265129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:59.266342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:59.266800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:59.267221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:59.297427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f116134-9d2e-4025-b826-9c394517c8ec tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052873 Sep 13 14:27:59.297992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1124/2335] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:27:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:27:59.694855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:27:59.695470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:27:59.701884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:59.702366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:59.702798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:59.703480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:27:59.703932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:27:59.704350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:27:59.836348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:27:59.844482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-71888290-d60e-468e-8fd8-dc44cab48b38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153487 Sep 13 14:27:59.845055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1212/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:27:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:00.310918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:00.313092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:00.320337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:00.320337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:00.320337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:00.321003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:00.321449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:00.321897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:00.352958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4cf188c4-8005-4e92-8530-4ece6c76c973 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Sep 13 14:28:00.353513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1125/2337] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:00.868185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:00.868798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:00.875232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:00.875712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:00.876141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:00.876894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:00.877930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:00.878352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:01.003984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:01.012071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-216f4f19-ea8f-48c2-848c-ba10c6f64282 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147674 Sep 13 14:28:01.012630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1213/2338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:00 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:01.365406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:01.367534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:01.373874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:01.374356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:01.374786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:01.375491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:01.375938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:01.376352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:01.406138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27a30975-5f99-4bee-8299-62d30ad09bff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045544 Sep 13 14:28:01.406690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1126/2339] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:02.035655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:02.036255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:02.042805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:02.043283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:02.043711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:02.044386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:02.044832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:02.045251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:02.176786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:02.184718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18b199af-1a14-43a8-8879-4ed30fd1d58f tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.153136 Sep 13 14:28:02.185278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1214/2340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:02 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:02.419189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:02.421232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:02.428432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:02.428909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:02.429548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:02.430038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:02.430494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:02.430918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:02.460963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-523b108d-d5e1-4d81-9cfb-c24c24602469 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 Sep 13 14:28:02.461525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1127/2341] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:03.208661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:03.209276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:03.215692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:03.216175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:03.216611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:03.217299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:03.217775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:03.218203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:03.348753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:03.356875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8336bb30-950d-44ef-92e7-aae7ae2c6b45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152452 Sep 13 14:28:03.357437 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1215/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:03.474036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:03.476094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:03.482509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:03.482988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:03.483447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:03.484131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:03.484586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:03.486701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:03.518351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d961cabe-5e16-4a63-a3f4-d18d24b16eab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Sep 13 14:28:03.518953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1128/2343] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:04.381970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:04.382612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:04.388938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:04.389416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:04.389875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:04.390551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:04.391004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:04.391425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:04.519868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:04.529063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-766fef78-a7c2-4fdc-a253-b9a065175ac3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151519 Sep 13 14:28:04.529602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1216/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:04.546728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:04.546728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:04.546728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:04.546728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:04.547806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:04.547806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:04.547806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:04.547806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:04.574936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-954ffbcf-d568-444c-be62-23ba1ef3ea30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048497 Sep 13 14:28:04.575503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1129/2345] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:05.552316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:05.552945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:05.559373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:05.559842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:05.560266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:05.560939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:05.561390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:05.561838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:05.587546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:05.589831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:05.597005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:05.597500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:05.597985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:05.598690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:05.599148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:05.599578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:05.630532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6e97533-150a-4624-97f5-1a98aec75a69 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Sep 13 14:28:05.631322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1130/2346] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:28:05.697364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:05.706028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e4005d40-083f-459a-823d-fdebb62b27bb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.156942 Sep 13 14:28:05.706611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1217/2347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:06.642767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:06.644954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:06.651627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:06.652093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:06.652517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:06.653237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:06.653631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:06.654072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:06.684037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d8667ab-6849-49f3-88b9-cdc09b901f92 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Sep 13 14:28:06.684589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1131/2348] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:06.728241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:06.728843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:06.735124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:06.735600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:06.736040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:06.737456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:06.738046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:06.738468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:06.866713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:06.875659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef5e5fb8-a22b-4ae7-ada0-7f976ac28e73 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150200 Sep 13 14:28:06.875659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1218/2349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:06 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:07.696433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:07.698598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:07.704866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:07.705336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:07.705784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:07.706966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:07.707407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:07.707822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:07.737709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4c2e1dd-24a7-480b-a920-fac1e0128db5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Sep 13 14:28:07.738490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1132/2350] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:07.898989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:07.899837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:07.906205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:07.906681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:07.907107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:07.907787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:07.908234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:07.908651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:08.036588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:08.044539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-909a181d-f50d-437b-adf7-47a49612a62b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150385 Sep 13 14:28:08.045112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1219/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:08.750390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:08.752543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:08.759028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:08.759517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:08.759971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:08.760634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:08.761121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:08.761545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:08.790963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0087e339-cad5-42c1-93fe-305f22e4d130 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Sep 13 14:28:08.791526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1133/2352] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:09.069097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:09.069637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:09.076134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:09.076615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:09.077051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:09.077762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:09.078226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:09.078652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:09.204870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:09.213463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7b0323e3-3f5f-42e9-a0b0-daa2ff6ce190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148627 Sep 13 14:28:09.214054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1220/2353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:09 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:09.803211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:09.805332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:09.811751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:09.812220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:09.812647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:09.813327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:09.813838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:09.814253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:09.843158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-181883f3-fe55-412c-95a1-4f3649badc7b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Sep 13 14:28:09.843711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1134/2354] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:10.236484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:10.237111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:10.239435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=54 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:10.244639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:10.245115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:10.245543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:10.246252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:10.246701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:10.247120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:10.378752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:10.387444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c33b80eb-a13c-4819-8965-055f4781a308 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154860 Sep 13 14:28:10.388021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1221/2355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:10 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:10.856241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:10.858354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:10.865504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:10.866005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:10.866441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:10.867124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:10.867580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:10.867999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:10.897160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e88943a-f9b8-4557-9d54-5c26edf6f3eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044802 Sep 13 14:28:10.897523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1135/2356] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:11.412400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:11.413003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:11.420028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:11.420508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:11.421096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:11.421821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:11.422287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:11.422728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:11.597693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:11.605801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7aed22ce-00e1-43c7-93b1-9973c7cf9255 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.197880 Sep 13 14:28:11.606366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1222/2357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:11 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:11.908424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:11.910638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:11.916994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:11.917469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:11.917944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:11.918622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:11.919086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:11.919489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:11.948885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee440ee1-2df3-4c0c-a0a3-55ac8921bd1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Sep 13 14:28:11.949427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1136/2358] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:12.629332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:12.629945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:12.636260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:12.636732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:12.637157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:12.637861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:12.638309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:12.638725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:12.763461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:12.773015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-85dd1500-10a2-4954-9139-2ab3ee0348e3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.147643 Sep 13 14:28:12.773598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1223/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:12 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:12.961085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:12.963239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:12.965567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=56 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:12.970790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:12.971265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:12.971698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:12.973251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:12.973710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:12.974156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:13.002783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b206beb9-96ce-4a7d-962c-f23ca54f2e2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Sep 13 14:28:13.003534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1137/2360] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:13.797567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:13.798124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:13.805484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:13.805998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:13.806438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:13.807116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:13.807573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:13.807984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:13.939893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:13.947951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33331c1c-4bab-4a1c-bae1-da5c424fcff3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154377 Sep 13 14:28:13.948503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1224/2361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:13 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:14.016319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:14.018493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:14.025205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:14.025680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:14.026148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:14.026825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:14.027268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:14.027684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:14.057407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-675cfd9d-280e-48f3-8fdd-620a64b810f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Sep 13 14:28:14.057913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1138/2362] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:14.970935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:14.971538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:14.978060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:14.978536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:14.978965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:14.979658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:14.980093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:14.980507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:15.069519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:15.071669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:15.077999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:15.078480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:15.078909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:15.079588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:15.080037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:15.080455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:15.105851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:15.107891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:15.110725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27015022-0993-437c-a97a-2cd7eb1edb14 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Sep 13 14:28:15.111610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1139/2363] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:28:15.116825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-98ef3333-e7bd-496d-9c9d-542e4e2663ac tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.149614 Sep 13 14:28:15.117383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1225/2364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:14 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:16.123023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:16.125155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:16.132363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:16.132835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:16.133268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:16.133967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:16.134414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:16.134834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:16.139609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:16.140254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:16.146958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:16.147440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:16.147875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:16.148565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:16.149023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:16.149451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:16.165003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bbcc2710-bdeb-4f8e-94eb-7819692e6542 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Sep 13 14:28:16.165587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1140/2365] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:16.282524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:16.290614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a04db1fe-88a2-49cf-8577-2d526556b91d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155028 Sep 13 14:28:16.291176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1226/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:16 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:17.177663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:17.179860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:17.186329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:17.186806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:17.187237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:17.187937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:17.188369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:17.188786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:17.217780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b05d6bd4-7b93-49a1-910e-7fcca4ca7cb0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Sep 13 14:28:17.218332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1141/2367] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Sep 13 14:28:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:28:17.313558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:17.314193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:17.321372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:17.321914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:17.322353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:17.323034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:17.323489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:17.323912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:17.327873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:17.462154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:17.471395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1045cbb8-5e9c-4123-9413-d46bb4a23e34 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.161525 Sep 13 14:28:17.472528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1227/2368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:17 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:18.230618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:28:18.232755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:18.239121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:18.239602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:18.240033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:18.240715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:18.241169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:18.241590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:18.340651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-febc66ea-b83a-4eb2-9963-36543cfd87ed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/action" status: 200 len: 76268 microversion: 2.1 time: 0.113707 Sep 13 14:28:18.342662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1142/2369] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Sep 13 14:28:18 2022] POST /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83/action => generated 76268 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 14:28:18.496295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:18.496887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:18.504107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:18.504596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:18.505024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:18.505706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:18.506182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:18.506605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:18.642264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:18.650759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-183beb91-9ca8-4fd1-b177-dd9a1f239513 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.158272 Sep 13 14:28:18.651321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1228/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:18 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:19.422938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:19.423545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:19.430610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:19.431086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:19.431511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:19.432201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:19.432648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:19.433068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:19.459621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:28:19.542552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15233389-edcd-4e75-9c07-ff300482f6b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 204 len: 0 microversion: 2.1 time: 0.123501 Sep 13 14:28:19.543375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1143/2371] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:28:19 2022] DELETE /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:28:19.553038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:19.553655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:19.560800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:19.561289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:19.561753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:19.562509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:19.562992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:19.563425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:19.674716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:19.675423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:19.682295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:19.682783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:19.683221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:19.683920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:19.684378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:19.684803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:19.696094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:19.704322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-223de69c-4730-428b-9d6f-4fa13da793df tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156713 Sep 13 14:28:19.704901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1229/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:19.859494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:19.868562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92217f4f-5384-46b8-aaff-e9cf489d9b8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.198229 Sep 13 14:28:19.869130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1144/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:19 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:20.728661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:20.729368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:20.735650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:20.736122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:20.736547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:20.737255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:20.737707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:20.738178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:20.866356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:20.874477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6e374c2a-0f7f-4c79-be13-547f1e2fe74d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149650 Sep 13 14:28:20.875051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1230/2374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:20 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:20.892092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:20.892825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:20.900202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:20.900684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:20.901120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:20.901841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:20.902298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:20.902720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:21.034666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:21.042868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-111c3df9-8ef7-476d-bc7a-71296029fb38 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154626 Sep 13 14:28:21.043438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1145/2375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:20 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:21.897441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:21.898070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:21.904365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:21.904841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:21.905267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:21.906256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:21.906713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:21.907129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:22.039420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:22.047548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d6ecdca7-731e-4a21-b603-800f0472aec2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154435 Sep 13 14:28:22.048108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1231/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:21 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:22.066000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:22.066610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:22.072902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:22.073406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:22.073869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:22.074550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:22.075000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:22.075420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:22.199951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:22.208461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd01109b-4ca2-45f1-9da8-fa3b33129a37 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.146383 Sep 13 14:28:22.209024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1146/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:22 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:23.071736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:23.072285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:23.078557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:23.079031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:23.079459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:23.080141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:23.080591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:23.081156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:23.207515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:23.215517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e811ba26-2588-4596-a633-b7c5b8033cd7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147620 Sep 13 14:28:23.216070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1232/2378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:23 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:23.232190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:23.232802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:23.239397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:23.239880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:23.240309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:23.240991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:23.241441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:23.241895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:23.374663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:23.383619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-916d26fd-4f6c-4245-b951-2bb7e409aede tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155243 Sep 13 14:28:23.384180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1147/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:23 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:24.239667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:24.240273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:24.246695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:24.247173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:24.247607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:24.248287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:24.248843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:24.249270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:24.380249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:24.388842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-164f1599-84d3-40fb-bd4b-c0567b0445e9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153567 Sep 13 14:28:24.389404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1233/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:24 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:24.408212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:24.408836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:24.416155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:24.416622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:24.417046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:24.417720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:24.418187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:24.418601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:24.546974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:24.555401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63940826-3286-4f0c-8411-01f47180efa2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150957 Sep 13 14:28:24.555964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1148/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:24 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:25.412348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:25.412888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:25.419269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:25.419746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:25.420176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:25.420856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:25.421308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:25.421744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:25.553536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:25.561772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4db897aa-b20f-41dc-b69c-0cf73a4f9568 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153308 Sep 13 14:28:25.562340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1234/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:25 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:25.578677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:25.579282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:25.585756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:25.586235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:25.586664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:25.587341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:25.587788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:25.588206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:25.712175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:25.720244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0fa650f-51a3-447b-a36e-75a858607fff tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.145396 Sep 13 14:28:25.720836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1149/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:25 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:26.585850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:26.586487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:26.592768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:26.593246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:26.593666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:26.594369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:26.594819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:26.595238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:26.723650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:26.731670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fba5ca52-fc8c-4739-980d-14ff72eab483 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150670 Sep 13 14:28:26.732226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1235/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:26 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:26.744332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:26.745037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:26.751460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:26.751940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:26.752381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:26.754026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:26.754495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:26.755308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:26.887645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:26.896474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d8da584-a051-464f-b518-aae8f4e4d02e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155988 Sep 13 14:28:26.897032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1150/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:26 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:27.755529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:27.756158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:27.762582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:27.763059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:27.763491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:27.764182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:27.764635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:27.765059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:27.894391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:27.903286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6bf0aae2-169e-4a9b-af08-4bd09b2280a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152281 Sep 13 14:28:27.904042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1236/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:27 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:27.920381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:27.921255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:27.928855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:27.929327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:27.929828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:27.930452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:27.931101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:27.931522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:28.056637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:28.064685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b9913607-2978-4dfc-aad8-63f417aee501 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148174 Sep 13 14:28:28.065301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1151/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:27 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:28.927734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:28.928348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:28.934887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:28.935371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:28.935825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:28.936516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:28.936967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:28.937385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:29.070723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:29.078773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7bc8730b-82e8-414b-837b-8c1aeb22ca14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155767 Sep 13 14:28:29.079335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1237/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:28 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:29.087779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:29.088523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:29.094997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:29.095483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:29.095920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:29.096654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:29.097117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:29.097537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:29.247772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:29.256556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3ced3864-1084-45fa-b9cc-3cf8b869ff18 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.172714 Sep 13 14:28:29.257124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1152/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:29 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:30.102476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:30.103087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:30.109758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:30.110250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:30.110683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:30.111364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:30.111817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:30.112933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:30.242691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:30.250882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48a4b08d-ca14-4dd5-8a4d-0772a2d3130e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152127 Sep 13 14:28:30.251381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1238/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:30 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:30.280576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:30.281187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:30.288465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:30.288945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:30.289378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:30.290090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:30.290541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:30.290965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:30.419181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:30.427943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ac919fb6-60a9-48f0-a9f1-9fabd659cd8a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151593 Sep 13 14:28:30.428505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1153/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:30 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:31.274623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:31.275237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:31.281590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:31.282110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:31.282545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:31.283236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:31.283693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:31.284781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:31.413476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:31.421657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b7c44f26-6704-4b46-9d66-52006bc0ab52 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151154 Sep 13 14:28:31.422247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1239/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:31 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:31.450632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:31.451271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:31.458265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:31.458745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:31.459178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:31.459888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:31.460358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:31.460808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:31.596672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:31.604780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bde6e76b-a5b8-43d4-beb2-9c6289f3e091 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157901 Sep 13 14:28:31.605345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1154/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:31 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:32.445122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:32.445744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:32.452216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:32.452693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:32.453120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:32.453821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:32.454275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:32.454691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:32.598470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:32.606625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db0f2461-010e-4362-82dc-c24dcc56ef15 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.165319 Sep 13 14:28:32.607193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1240/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:32 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:32.629548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:32.630107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:32.636446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:32.636925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:32.637357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:32.638094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:32.638548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:32.638969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:32.643650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:32.767274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:32.776310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5c1ed01c-c253-432a-8abf-9d440d7153af tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150884 Sep 13 14:28:32.776868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1155/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:32 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:33.630347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:33.630963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:33.637357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:33.637871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:33.638309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:33.639032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:33.639466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:33.639921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:33.769219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:33.777543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-331c16b1-ba5e-4a7a-8f4f-6054b414a06f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151127 Sep 13 14:28:33.778130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1241/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:33 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:33.799847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:33.800482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:33.807168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:33.807648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:33.808081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:33.808797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:33.809251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:33.809671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:33.941552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:33.950513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab9267db-033e-4141-9558-d38d8dbee354 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154503 Sep 13 14:28:33.951391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1156/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:33 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:34.801758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:34.803185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:34.809777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:34.810263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:34.810689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:34.811367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:34.811814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:34.812229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:34.938994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:34.947120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb510675-f50b-478a-8551-6f681a37639b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150369 Sep 13 14:28:34.947684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1242/2398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:34 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:34.974679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:34.975303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:34.981686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:34.982195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:34.982639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:34.983299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:34.983742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:34.984158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:35.112587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:35.120729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2dce68c-893f-4a6a-a4df-1712e6a24a7b tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150581 Sep 13 14:28:35.121282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1157/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:34 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:35.970370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:35.970978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:35.978106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:35.978579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:35.979035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:35.979710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:35.980154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:35.980576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:36.111980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:36.116002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:36.121587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a6023885-5f97-4d76-bdf0-ed77abd5b430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155030 Sep 13 14:28:36.122246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1243/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:35 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:36.143593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:36.144205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:36.150877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:36.151404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:36.151830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:36.152505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:36.152951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:36.153367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:36.282355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:36.291366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4986626-22f3-4b29-a5c1-4dcda4895b3a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151608 Sep 13 14:28:36.291990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1158/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:36 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:37.144313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:37.144923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:37.151737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:37.152206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:37.152639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:37.153325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:37.153811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:37.154236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:37.279656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:37.287866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a451dfee-3f88-4d5e-8c8b-571652c14616 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147414 Sep 13 14:28:37.288427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1244/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:37 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:37.315724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:37.317135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:37.323536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:37.324012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:37.324438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:37.325117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:37.325568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:37.326022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:37.452672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:37.460774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-749a7c0b-4c4a-4fef-9174-7a5e5fea5793 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.148874 Sep 13 14:28:37.461487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1159/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:37 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:38.310711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:38.311324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:38.318624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:38.319143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:38.319579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:38.320265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:38.320726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:38.321151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:38.451362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:38.460078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46cd7a74-965d-4b3d-9d36-ecd954c2fff5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153189 Sep 13 14:28:38.460638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1245/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:38 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:38.484069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:38.484767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:38.492147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:38.492716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:38.493239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:38.494025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:38.494574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:38.495003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:38.623918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:38.632082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f56b95df-2ad8-446c-a854-0f0b22b751e0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151763 Sep 13 14:28:38.632645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1160/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:38 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:39.482796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:39.483357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:39.490598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:39.491096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:39.491526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:39.492200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:39.492651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:39.493068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:39.633371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:39.641491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b73a8c4-ac09-4eac-9b6d-8fd78a196179 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162607 Sep 13 14:28:39.642080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1246/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:39 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:39.656226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:39.656830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:39.663244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:39.663720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:39.664150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:39.664829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:39.665289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:39.665709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:39.795572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:39.804446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27db9188-64d9-4fd4-87b2-eab8fbdfc2e2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152122 Sep 13 14:28:39.805005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1161/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:39 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:40.711375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:40.711990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:40.713849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=52 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:40.719066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:40.719551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:40.719989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:40.720677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:40.721134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:40.721561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:40.827692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:40.829071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:40.837039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:40.837639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:40.838179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:40.838931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:40.839399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:40.840153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:40.851818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:40.869125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d23d714c-730a-4ff5-b589-1c9ee76bd25c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.208563 Sep 13 14:28:40.869940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1247/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:40 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:40.967373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:40.975493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b60f69f-e687-4e0f-9ad8-99ea7fd05e45 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151698 Sep 13 14:28:40.976050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1162/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:40 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:41.892224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:41.892833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:41.900210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:41.900629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:41.901059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:41.901749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:41.902285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:41.902610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:41.999569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:42.000200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:42.007202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:42.007684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:42.008152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:42.008846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:42.009312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:42.009753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:42.042203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:42.050338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2eb9aa8-4b6a-4a9b-abf4-6a768a248e01 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.161837 Sep 13 14:28:42.050901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1248/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:41 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:42.145881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:42.153806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99f037d0-1b12-4c76-a5ad-e954f3338045 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157871 Sep 13 14:28:42.154319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1163/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:41 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:43.074515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:43.075125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:43.081515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:43.082072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:43.082506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:43.083191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:43.083644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:43.084064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:43.177514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:43.178170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:43.180698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:43.186464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:43.186964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:43.187363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:43.188058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:43.188508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:43.188936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:43.223390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:43.231897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5f13feb1-da08-4856-a041-7728c54e8f30 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.161174 Sep 13 14:28:43.232457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1249/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:43.318042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:43.326074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7b876c2-2137-4a75-8e01-4dbd5d1654f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.152468 Sep 13 14:28:43.326631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1164/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:43 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:44.255475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:44.256116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:44.262518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:44.262942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:44.263378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:44.264071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:44.264719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:44.264972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:44.350453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:44.351066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:44.357786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:44.358604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:44.359038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:44.359726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:44.360178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:44.360594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:44.397601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:44.405844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4c7a3ab4-6fbd-4b53-a88d-0a72785c1026 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154287 Sep 13 14:28:44.406413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1250/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:44 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:44.488274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:44.496892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f329452-fa86-4cfd-b22a-387e0a5dfb7d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150969 Sep 13 14:28:44.497457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1165/2415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:44 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:45.429984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:45.430621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:45.437407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:45.438000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:45.438429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:45.439138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:45.439590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:45.440006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:45.520740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:45.521499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:45.530041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:45.530041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:45.530041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:45.530449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:45.530906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:45.531370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:45.572530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:45.585614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-621adb33-8093-4fd8-a139-3da4bc216578 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159524 Sep 13 14:28:45.586601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1251/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:45 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:45.666411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:45.674344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-58153ee8-7cb8-4def-8543-c02a42dd8a27 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.157873 Sep 13 14:28:45.675454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1166/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:45 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:46.609115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:46.609700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:46.615614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:46.616084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:46.616510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:46.617186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:46.617634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:46.618086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:46.699982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:46.700661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:46.708020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:46.708575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:46.709124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:46.710293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:46.710786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:46.711203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:46.751223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:46.759986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-75342825-7b3d-482a-9c25-35fc12eef777 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155001 Sep 13 14:28:46.760565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1252/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:46 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:46.837948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:46.846118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6242826-785f-4876-a46b-7a40089cbbdb tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150218 Sep 13 14:28:46.846682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1167/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:46 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:47.785231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:47.785879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:47.792434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:47.792906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:47.793334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:47.794050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:47.794502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:47.794951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:47.871113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:47.871727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:47.878344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:47.878810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:47.879248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:47.879953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:47.880409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:47.880842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:47.941861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:47.950091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c9b51496-c7f3-4906-a10e-00b8993e9665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.169395 Sep 13 14:28:47.950657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1253/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:47 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:48.015891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:48.025221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d3f58bd-6b25-45f6-9f0b-01fc3387163d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.158967 Sep 13 14:28:48.025890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1168/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:47 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:48.974105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:48.974720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:48.981093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:48.981572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:48.982042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:48.982726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:48.983180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:48.983600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:49.047935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:49.048550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:49.056185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:49.056738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:49.057239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:49.058097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:49.058628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:49.059150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:49.114424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:49.122682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f9db7b79-31de-4585-8ea6-6c85e714c66d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153059 Sep 13 14:28:49.123251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1254/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:49.190097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:49.198244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-395059da-1a94-405b-b498-229b0a6d8b07 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154276 Sep 13 14:28:49.198804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1169/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:49 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:50.145418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:50.146344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:50.152372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:50.152848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:50.153279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:50.153984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:50.154439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:50.154863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:50.222730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:50.223334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:50.229545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:50.230065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:50.230505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:50.231199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:50.231650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:50.232082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:50.291057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:50.299211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-87704c34-d658-4b61-9332-712f5a7abe56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157571 Sep 13 14:28:50.300643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1255/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:50.364408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:50.372710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0bad939-77ea-41a9-80c0-4c6e213b57f1 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.154831 Sep 13 14:28:50.373283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1170/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:50 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:51.322732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:51.323340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:51.329805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:51.330285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:51.330719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:51.332122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:51.332571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:51.332990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:51.396183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:51.396784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:51.403190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:51.403668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:51.404099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:51.404783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:51.405231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:51.405651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:51.462380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:51.471032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-25f7e41f-630f-41e4-b02f-4b1290c83a02 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152105 Sep 13 14:28:51.471858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1256/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:51 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:51.543861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:51.547345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:51.553422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-349b17ac-4779-4185-9610-ccc0ad5663f5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.161426 Sep 13 14:28:51.554029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1171/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:51 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:52.494585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:52.495200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:52.501476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:52.502008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:52.502447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:52.503227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:52.503750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:52.504175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:52.576472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:52.577074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:52.583570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:52.584332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:52.584449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:52.585131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:52.585580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:52.586023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:52.640798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:52.649368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bde2c44a-d32e-4df9-9284-52cd7b999eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158566 Sep 13 14:28:52.649997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1257/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:52.715300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:52.724006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a04c8181-48f2-43bc-9fb9-ce523731dac2 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151534 Sep 13 14:28:52.724575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1172/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:52 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:53.035367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:53.035871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:53.041771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.042261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.042700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.043389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.043846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.044275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.068300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:28:53.118765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:28:53.148448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-425de9ae-cc8d-4dc2-a4dc-2eaeeea46b89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 204 len: 0 microversion: 2.20 time: 0.117407 Sep 13 14:28:53.149030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1258/2430] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 13 14:28:53 2022] DELETE /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 14:28:53.157813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:53.158453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:53.164923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.165414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.165870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.166563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.167017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.167443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.298328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:53.307156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:53.308716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:53.310051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4497b4d-41a3-4e59-894f-2e1eaf3ee496 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156614 Sep 13 14:28:53.310613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1173/2431] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:28:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:28:53.672951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:53.673661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:53.680705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.681185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.681619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.682323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.682783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.683204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.748108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:53.748717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:53.755430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.755951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.756333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.757020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:53.757463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:53.757906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:53.814878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:53.823996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1379d3f9-0470-4111-bafd-7509baf7f052 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155290 Sep 13 14:28:53.824564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1259/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:53 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:53.886957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:53.895006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73c16a54-bd6a-4884-9f78-5ee5c60422b8 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150785 Sep 13 14:28:53.895804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1174/2433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:53 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:54.335094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:54.335735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:54.341689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:54.342192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:54.342622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:54.343297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:54.343750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:54.344166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:54.472180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:54.481568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:54.483025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:54.484174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bc4eb8ca-5703-4066-ad0e-8d65d725dcd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153069 Sep 13 14:28:54.484727 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1260/2434] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:28:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:28:54.847000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:54.847604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:54.853957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:54.854431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:54.854938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:54.855626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:54.856069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:54.856487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:54.918274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:54.919000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:54.925834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:54.926393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:54.926902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:54.927659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:54.928191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:54.928683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:54.990632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:54.998947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2470e939-d490-4fc3-bfc8-e73a3cb8d267 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155730 Sep 13 14:28:54.999842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1175/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:55.061065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:55.070440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca4e483b-bf50-4dbd-8f1e-d080957100ea tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.156022 Sep 13 14:28:55.071010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1261/2436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:54 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:55.508966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:55.509562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:55.515539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:55.516014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:55.516444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:55.517119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:55.517572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:55.518029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:55.650814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:55.659945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:55.661416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:55.662606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cafc5251-ce59-4718-874b-3efea68662a1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157480 Sep 13 14:28:55.663194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1176/2437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:28:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:28:56.023666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:56.024280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:56.030638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:56.031126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:56.031565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:56.032252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:56.032714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:56.033144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:56.095824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:56.096675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:56.103611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:56.104157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:56.104655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:56.105402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:56.105952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:56.106438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:56.164247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:56.172473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db38bab3-6839-4b14-a85a-5da8a489c1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152923 Sep 13 14:28:56.172988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1262/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:56.233823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:56.242155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76807a41-f2fc-4523-b571-3f81186092c5 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150153 Sep 13 14:28:56.242723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1177/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:56 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:56.688038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:56.688645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:56.695477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:56.695942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:56.696368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:56.697054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:56.697503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:56.697955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:56.828254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:56.837122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:56.838607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:56.839768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1563c201-dd74-4f7f-9a35-90a235d4a852 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155617 Sep 13 14:28:56.840327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1263/2440] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:28:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:28:57.195433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:57.196047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:57.202454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:57.202931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:57.203365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:57.204075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:57.204557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:57.205008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:57.265692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:57.266292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:57.273718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:57.274414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:57.275073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:57.277311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:57.277881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:57.278436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:57.338065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:57.346458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-63271fe5-8f58-462e-81c3-d4cebcc86d8c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154899 Sep 13 14:28:57.347555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1178/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:57 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:57.407848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:57.416852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7963fb1c-223b-4cec-94ae-bb15444c579c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155127 Sep 13 14:28:57.417413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1264/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:57 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:28:57.866134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:57.866750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:57.873850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:57.874483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:57.874969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:57.875768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:57.876268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:57.876730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:58.001389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:58.010852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:58.012378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:58.013534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7323af76-2dc8-4dff-981d-97de215fd08e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151258 Sep 13 14:28:58.014146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1179/2443] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:28:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:28:58.372243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:58.372848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:58.388370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:58.389222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:58.389661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:58.390391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:58.390849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:58.391275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:58.441696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:58.443463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:58.453697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:58.454220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:58.454654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:58.455352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:58.455802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:58.456797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:58.545856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:58.555321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9dff8276-7a69-4d66-9ff4-bae2a0b562ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.186782 Sep 13 14:28:58.556243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1265/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:58 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:58.634591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:58.649970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f891499-ebd2-4864-92f3-6fc7c503f09c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.211516 Sep 13 14:28:58.653869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1180/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:58 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:59.040169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:59.040776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:59.046665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:59.047146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:59.047580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:59.048258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:59.048711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:59.049134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:59.176939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:59.185485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:59.186958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:59.188096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fe52d711-2da8-47f5-8df7-36a2f3423459 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151840 Sep 13 14:28:59.188649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1266/2446] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:28:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:28:59.579079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:59.579685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:59.587001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:59.587470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:59.587901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:59.588580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:59.589030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:59.589450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:59.672551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:28:59.673157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:28:59.680612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:59.681176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:59.681519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:59.682604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:28:59.682732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:28:59.683081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:28:59.724400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:59.732720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ff8cc47-7858-4b15-a8c4-1fe29cc72dfd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157531 Sep 13 14:28:59.733346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1181/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:28:59.814979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:28:59.824587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ea0b174b-23f2-4d4f-b9f5-ce639ac940a7 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.155768 Sep 13 14:28:59.825164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1267/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:28:59 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:00.212596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:00.213197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:00.219097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:00.219574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:00.220009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:00.220689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:00.221142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:00.222101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:00.351292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:00.359793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:00.361262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:00.363158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1a45db5-bf79-4d9f-9ef8-f1cd15442418 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153877 Sep 13 14:29:00.363708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1182/2449] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:00.756892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:00.757583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:00.763960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:00.764510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:00.764946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:00.765628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:00.766107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:00.766523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:00.848703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:00.849316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:00.855799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:00.856259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:00.856692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:00.857384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:00.857886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:00.858469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:00.899066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:00.907319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-161c8827-fb7f-47ac-8626-d53f43d1b1a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155037 Sep 13 14:29:00.907890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1268/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:00 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:00.987022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:00.995622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25101a67-8928-41b4-8662-3e59199c3cab tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150856 Sep 13 14:29:00.996181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1183/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:00 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:01.387563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:01.388085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:01.394920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:01.395393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:01.396077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:01.396748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:01.397192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:01.397633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:01.526231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:01.535296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:01.536734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:01.537940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4a070aee-9d23-45e6-8641-511346596cf5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154297 Sep 13 14:29:01.538491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1269/2452] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:01.930179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:01.930784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:01.937248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:01.937744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:01.938202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:01.938887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:01.939342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:01.939763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:02.021029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:02.021663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:02.028400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:02.028881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:02.029312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:02.030032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:02.030482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:02.030899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:02.065955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:29:02.066216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 (ip 10.222.0.20) !!! Sep 13 14:29:02.082267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:02.090520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e87991c1-5825-4d4b-b0dc-a80c706ca57e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.164130 Sep 13 14:29:02.091086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1184/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:02.172841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:02.181029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-49fc372f-ea5a-4864-8c55-06d97fe73632 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.165822 Sep 13 14:29:02.181587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1270/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:02 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:02.562935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:02.563532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:02.570235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:02.570705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:02.571130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:02.571804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:02.572249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:02.572667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:02.702762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:02.711308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:02.712765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:02.713934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-839aae0b-fcad-43b8-bc30-0832360d4679 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154906 Sep 13 14:29:02.714489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1185/2455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:03.114394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:03.115003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:03.121434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:03.122081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:03.122443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:03.123218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:03.123671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:03.124314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:03.203773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:03.204377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:03.211261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:03.211731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:03.212161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:03.212844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:03.213292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:03.213704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:03.251783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:03.260562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5624c698-3566-449e-bb92-e8bef93b5f61 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150679 Sep 13 14:29:03.261133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1271/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:03 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:03.342428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:03.351061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-773fcbb4-160e-4189-a5c4-b3fc77659aaf tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.151150 Sep 13 14:29:03.351644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1186/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:03 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:03.738962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:03.739558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:03.745473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:03.745979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:03.746406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:03.747077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:03.747523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:03.747934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:03.874647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:03.883694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:03.885102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:03.886273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d5df1760-ebe1-4764-af89-6737fe06467d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151323 Sep 13 14:29:03.886824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1272/2458] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:04.285403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:04.286040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:04.292529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:04.293005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:04.293439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:04.294147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:04.294600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:04.295019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:04.375600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:04.376212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:04.384678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:04.385240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:04.385678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:04.386398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:04.386848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:04.387498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:04.429744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:04.438027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4df234d4-60d4-4689-aa99-e363914ced4b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156411 Sep 13 14:29:04.438632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1187/2459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:04 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:04.534378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:04.542806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-95f75a72-2793-4b48-bfb7-3c00207edd5c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.170955 Sep 13 14:29:04.543444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1273/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:04 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:04.913062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:04.913707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:04.919646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:04.920129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:04.920565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:04.921252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:04.921841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:04.922156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:04.939733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:05.053372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:05.061892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:05.063470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:05.064603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e562ae0-e031-4e5d-b484-4fa2b76d6993 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156375 Sep 13 14:29:05.065413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1188/2461] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:05.462965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:05.463580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:05.470023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:05.470505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:05.470940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:05.471894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:05.472507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:05.472939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:05.568057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:05.568667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:05.574881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:05.575355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:05.575784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:05.576461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:05.576902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:05.577317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:05.599240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:05.607466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3faf9fae-ceed-444e-9a2b-27c8c403c3c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148284 Sep 13 14:29:05.608016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1274/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:05.705346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:05.713839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46277543-4dd4-4f6c-bfe9-e42311523916 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150471 Sep 13 14:29:05.714405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1189/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:05 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:06.090472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:06.091113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:06.097480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:06.098005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:06.098440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:06.099120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:06.099571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:06.099991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:06.117951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:06.230864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:06.239571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:06.241015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:06.242188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-27f68dba-9a34-4d95-b94f-2c7ee595e6b5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155648 Sep 13 14:29:06.242749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1275/2464] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:06.631692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:06.632281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:06.638696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:06.639199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:06.639629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:06.640302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:06.640747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:06.641162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:06.736326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:06.736978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:06.743855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:06.744337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:06.744778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:06.745462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:06.745949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:06.746376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:06.770205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:06.778749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d041de7-d213-4e09-bff5-8924b24cd9da tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151855 Sep 13 14:29:06.779734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1190/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:06 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:06.874029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:06.882933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-16e5fc3b-d373-4507-ae53-abec0d7a0c0d tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150417 Sep 13 14:29:06.883509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1276/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:06 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:07.267574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:07.268898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:07.275097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:07.275572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:07.275998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:07.276672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:07.277117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:07.277541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:07.405778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:07.415112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:07.416612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:07.417934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6980d9c-760c-4ded-85cc-1bf2c0d8d83f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154184 Sep 13 14:29:07.418482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1191/2467] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:07.804346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:07.804956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:07.811413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:07.811893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:07.812324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:07.813000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:07.813454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:07.813909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:07.906246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:07.906863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 75f1a1a8-03b2-4087-a62a-885a432f4852] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:07.913303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:07.913819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:07.914259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:07.915013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:07.915472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:07.915931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:07.944859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:07.953163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c5654e2-693b-46c9-b1ad-72520585f7a1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152707 Sep 13 14:29:07.953755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1277/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:07 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:08.044510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:08.053103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-639e23a8-f0a6-439e-a9a4-faaeaf3b390c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852" status: 200 len: 1733 microversion: 2.1 time: 0.150697 Sep 13 14:29:08.053675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1192/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:07 2022] GET /compute/v2.1/servers/75f1a1a8-03b2-4087-a62a-885a432f4852 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:08.075936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65a27ab9-e9ec-4ac7-863c-a190e529153e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '.version_select at 0x7fc9d42d4c10>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:08.097415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65a27ab9-e9ec-4ac7-863c-a190e529153e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241516179" status: 202 len: 0 microversion: 2.1 time: 0.025305 Sep 13 14:29:08.098006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1278/2470] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 13 14:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241516179 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:29:08.443159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:08.443921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:08.449800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:08.450364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:08.450866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:08.451622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:08.452154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:08.452643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:08.584590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:08.599238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:08.599238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:08.599238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f4fef6d-62ca-45ba-9344-30156e5c94d0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156741 Sep 13 14:29:08.599773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1193/2471] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:08.977657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:08.978298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:08.984439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:08.984920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:08.985347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:08.986071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:08.986520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:08.987654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.220901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:09.230661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9121d82-e8e4-415b-97c6-58eaabc74b25 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.257252 Sep 13 14:29:09.231343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1279/2472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:08 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:09.369091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-5f92e9b3-5959-4fac-b2e9-e6c4a884d392 req-23e33f55-d487-45d9-b1ea-50c57734082c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75f1a1a8-03b2-4087-a62a-885a432f4852", "tag": "5b53af25-2b95-41ce-9f86-e80d09df687e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:29:09.378814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5f92e9b3-5959-4fac-b2e9-e6c4a884d392 req-23e33f55-d487-45d9-b1ea-50c57734082c service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.379289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5f92e9b3-5959-4fac-b2e9-e6c4a884d392 req-23e33f55-d487-45d9-b1ea-50c57734082c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.379745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-5f92e9b3-5959-4fac-b2e9-e6c4a884d392 req-23e33f55-d487-45d9-b1ea-50c57734082c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.392054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-5f92e9b3-5959-4fac-b2e9-e6c4a884d392 req-23e33f55-d487-45d9-b1ea-50c57734082c service nova] Creating event network-changed:5b53af25-2b95-41ce-9f86-e80d09df687e for instance 75f1a1a8-03b2-4087-a62a-885a432f4852 on hv-cinder-85743 Sep 13 14:29:09.399117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-5f92e9b3-5959-4fac-b2e9-e6c4a884d392 req-23e33f55-d487-45d9-b1ea-50c57734082c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091295 Sep 13 14:29:09.405562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1194/2473] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:29:09.622552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:09.622967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:09.628988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.629478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.629964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.630674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.631123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.631548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.751101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:09.751472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:09.758265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.758751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.759181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.759875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.760326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.760747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.791480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:09.807064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:29:09.810663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:09.812206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:09.813813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2d4c4099-ba80-401b-89d9-95beefa3edea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.195294 Sep 13 14:29:09.814339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1280/2474] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:09.915595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe73b8d6-521d-42d8-8295-04e93040a722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 204 len: 0 microversion: 2.1 time: 0.168489 Sep 13 14:29:09.916491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1195/2475] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:29:09 2022] DELETE /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:29:09.924681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:09.925910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:09.932468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.932970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.933408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:09.934420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:09.934887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:09.935521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:10.070565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:10.078835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30c8a220-1a04-4479-998f-e361f9c95b50 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158008 Sep 13 14:29:10.079403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1281/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:10.255932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:10.256725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:10.263218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:10.263795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:10.264306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:10.265086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:10.265614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:10.266147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:10.415539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:10.425168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4188e14b-2594-4652-995d-6081c82327c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.174005 Sep 13 14:29:10.425803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1196/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:10 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:10.838454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:10.839055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:10.840923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:10.846660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:10.847244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:10.847683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:10.848359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:10.848812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:10.849233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:10.981097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:10.989840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:10.991288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:10.992446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6ba5f776-948b-408d-a5f5-4aeec6d013c5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157868 Sep 13 14:29:10.993002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1282/2478] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:11.103358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:11.103894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:11.109999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:11.110475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:11.110909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:11.111591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:11.112468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:11.112895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:11.259324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:11.267429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a4e6f0f7-938d-4f34-9ccb-dc0369813ec1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.167960 Sep 13 14:29:11.267992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1197/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:11.448277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:11.448895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:11.454938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:11.455421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:11.456555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:11.457237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:11.457691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:11.458143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:11.585903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:11.594394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-57dbd6e3-335a-426c-9cc9-13d482be99bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149951 Sep 13 14:29:11.595049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1283/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:11 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:12.017849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:12.019057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:12.025812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:12.026297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:12.026743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:12.027421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:12.027874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:12.028297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:12.153848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:12.162675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:12.164107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:12.165256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5e894f06-bd96-4aa6-b9ed-46462991b297 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151433 Sep 13 14:29:12.165831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1198/2481] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:12.291437 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:12.292050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:12.298503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:12.298986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:12.299457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:12.300156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:12.300610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:12.301037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:12.432314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:12.441847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78532fca-50f7-444c-9454-f4e79b385486 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154207 Sep 13 14:29:12.442415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1284/2482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:12.618669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:12.619348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:12.625310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:12.625823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:12.626256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:12.626944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:12.628427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:12.628871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:12.758168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:12.766378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb538aee-cf68-4b6d-9ad7-ccb4f9fb86be tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151597 Sep 13 14:29:12.766944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1199/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:12 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:13.190741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:13.191342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:13.197338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:13.197841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:13.198272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:13.198945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:13.199390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:13.199837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:13.328429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:13.337483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:13.339064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:13.340213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0003e037-f0cf-47e2-9865-5dad52908529 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153756 Sep 13 14:29:13.340758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1285/2484] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:13.466016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:13.466667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:13.469244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:13.475393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:13.475879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:13.476317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:13.477048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:13.477502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:13.477959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:13.607479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:13.616039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc295ab2-647e-4f69-838a-6c10cec513af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153900 Sep 13 14:29:13.616618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1200/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:13.789867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:13.790479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:13.796356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:13.796855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:13.797288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:13.797990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:13.798446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:13.798867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:13.925570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:13.933712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-838dc756-7f69-499e-9be6-e132dc4c86dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147660 Sep 13 14:29:13.934296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1286/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:13 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:14.366264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:14.366860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:14.373016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:14.373485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:14.373952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:14.374624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:14.375067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:14.375482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:14.502574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:14.511041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:14.512470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:14.513647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10b06720-3e55-4abc-b7fa-7bcdd2158875 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152019 Sep 13 14:29:14.514247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1201/2487] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:14.639605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:14.640200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:14.647428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:14.647908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:14.648341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:14.649021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:14.649475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:14.649930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:14.783424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:14.792132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d6f0ec2-a406-49d8-912a-a3db93d3b896 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156371 Sep 13 14:29:14.792692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1287/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:14.958041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:14.958573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:14.964469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:14.964946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:14.965376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:14.966084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:14.966535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:14.966957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:15.096109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:15.104394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39097041-d53a-4b66-9bae-acb780ce58fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150815 Sep 13 14:29:15.104962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1202/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:14 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:15.539370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:15.539974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:15.546098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:15.546578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:15.547009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:15.547683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:15.548131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:15.548549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:15.677178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:15.685616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:15.687089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:15.688230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-724dec6e-fa6b-421c-aa08-9b32e760f18d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152823 Sep 13 14:29:15.688778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1288/2490] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:15.815628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:15.816247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:15.822789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:15.823278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:15.823712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:15.824407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:15.824852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:15.825280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:15.953564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:15.961811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f13103d9-8607-4dbb-8658-3f0abc952fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150070 Sep 13 14:29:15.962384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1203/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:16.128058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:16.128660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:16.134588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:16.135065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:16.135492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:16.136163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:16.136610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:16.137025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:16.265330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:16.274247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-151d4f66-485d-4853-8e1a-fa71313e561a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150321 Sep 13 14:29:16.274803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1289/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:16 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:16.713578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:16.714206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:16.720122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:16.720599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:16.721047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:16.721736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:16.722194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:16.722609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:16.726539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:16.986283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:16.987459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:16.994033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:16.994515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:16.994946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:16.995649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:16.996133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:16.996552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:17.094001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:17.103625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:17.105310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:17.106511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-487c9d0d-a89f-41db-896e-48ad0e0d2e4a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.396780 Sep 13 14:29:17.107079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1204/2493] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:17.130778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:17.138851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c5c6df6-cf0f-42f9-bcc6-fa02f925a5b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156450 Sep 13 14:29:17.139421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1290/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:17.298464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:17.299063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:17.305971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:17.306443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:17.306873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:17.307545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:17.307992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:17.308409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:17.433602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:17.444209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d8f8ddc-fb5d-4b06-9194-ce7f6b235007 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149483 Sep 13 14:29:17.444794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1205/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:17 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:18.132648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:18.133248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:18.139614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:18.140091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:18.140519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:18.141192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:18.141639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:18.142083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:18.162738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:18.163331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:18.169671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:18.170191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:18.170621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:18.171304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:18.171755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:18.172185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:18.275982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:18.284612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:18.286091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:18.287247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-86188af0-bbce-4e14-bc8f-1503c6a70810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158508 Sep 13 14:29:18.287809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1291/2496] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:18.301327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:18.309561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-283badac-dc4c-4981-85bb-7dede71d0be5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150662 Sep 13 14:29:18.310166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1206/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:18.467029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:18.467635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:18.473881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:18.474305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:18.474734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:18.475409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:18.475859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:18.476277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:18.605620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:18.614230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6fe7205b-9c00-4642-aa4b-416b031e894d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151011 Sep 13 14:29:18.614791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1292/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:18 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:19.312638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:19.313195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:19.320021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:19.320502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:19.320946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:19.321637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:19.322119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:19.322546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:19.333291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:19.333927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:19.340503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:19.340984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:19.341413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:19.342127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:19.342571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:19.342984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:19.347591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:19.454343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:19.463405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:19.464843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:19.466018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6044ea0-0d36-40ef-8578-730db8cbaacf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157339 Sep 13 14:29:19.466580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1207/2499] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:19.474833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:19.483288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-29d6cdd1-9394-45d6-8e8c-7cb4aca7d56a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154328 Sep 13 14:29:19.483879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1293/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:19.638272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:19.638808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:19.645614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:19.646384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:19.646818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:19.647526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:19.647978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:19.648400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:19.774950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:19.783594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49fb4456-0375-4340-b547-951ca4134f7a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148862 Sep 13 14:29:19.784084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1208/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:20.491361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:20.491971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:20.498533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:20.499013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:20.499447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:20.500232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:20.500693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:20.501188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:20.506283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:20.506901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:20.513272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:20.513782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:20.514225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:20.514913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:20.515369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:20.515791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:20.633534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:20.642212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:20.644168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:20.645334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-75cee82d-12cd-4ae1-9cd3-886e3e1c8b56 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158586 Sep 13 14:29:20.646185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1294/2502] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:20.649569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:20.657771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ee241cb-152b-4932-9e86-66c468670797 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155543 Sep 13 14:29:20.658421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1209/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:20.807538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:20.808147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:20.814035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:20.814550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:20.815003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:20.815681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:20.816134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:20.816555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:20.945186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:20.953604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-97db87b0-3b78-4800-9e0d-bb56c9662f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149861 Sep 13 14:29:20.954274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1295/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:20 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:21.671018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:21.671624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:21.678676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:21.679163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:21.679596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:21.680284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:21.680733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:21.680992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:21.681415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:21.681616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:21.688065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:21.688550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:21.688996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:21.689698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:21.691157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:21.691608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:21.812265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:21.821393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:21.822884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:21.824054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-77f25ed0-98d8-43fa-ae72-8abb1c5febcf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156922 Sep 13 14:29:21.824618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1210/2505] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:21.825612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:21.834327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c8cb976a-d546-4ae2-8aaa-a9cf9a325a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157172 Sep 13 14:29:21.835052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1296/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:21.977013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:21.977625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:21.983600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:21.984080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:21.984510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:21.985186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:21.985635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:21.986080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:22.118087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:22.126206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d9e1e2f-1ea5-448d-8018-df6dcbfaacd4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153000 Sep 13 14:29:22.126767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1211/2507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:21 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:22.849783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:22.850386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:22.857015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:22.857501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:22.857833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:22.858281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:22.858566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:22.858697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:22.859059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:22.859475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:22.865531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:22.866034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:22.866467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:22.867157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:22.867608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:22.868029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:22.991965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:22.999148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:23.004311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:23.006193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:23.007352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2263e42f-de87-45a2-a7f6-2ac611b6b754 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161575 Sep 13 14:29:23.007893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1297/2508] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:23.009147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5acee546-5222-44a7-92dc-4a941d805976 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155042 Sep 13 14:29:23.009715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1212/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:23.150675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:23.151459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:23.157975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:23.159545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:23.160011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:23.160698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:23.161149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:23.161569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:23.290375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:23.298528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d0ef986-189b-481c-852c-07bfc68067ab tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152025 Sep 13 14:29:23.299148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1298/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:23 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:24.032434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:24.033127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:24.034768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:24.035387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:24.039994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:24.040704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:24.041133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:24.041659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:24.041877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:24.042174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:24.042309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:24.042609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:24.042732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:24.043306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:24.043821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:24.044585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:24.175190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:24.176584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:24.184027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:24.184704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88bc4303-dc67-4829-9379-903ff768ec7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156183 Sep 13 14:29:24.187284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:24.187467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1299/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:24.187577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-be454f89-2887-4b28-8692-98fdc33c1ee6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158249 Sep 13 14:29:24.187577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1213/2512] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:24.320945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:24.321553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:24.327495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:24.327915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:24.328347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:24.329028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:24.329483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:24.329929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:24.455150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:24.464082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18a707a9-a0b6-4662-8830-df1ac210da3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.146942 Sep 13 14:29:24.464663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1300/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:24 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:25.208330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:25.208942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:25.212076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:25.212691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:25.215500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:25.215983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:25.216414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:25.217108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:25.217564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:25.218033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:25.218961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:25.219447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:25.219913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:25.220642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:25.221344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:25.222087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:25.352066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:25.358965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:25.367383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9cf9f52a-fe0d-4828-81fa-dbe22bb04e14 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163037 Sep 13 14:29:25.367968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1214/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:25.374056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:25.375502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:25.376643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a3a90ff2-e1b7-4dce-afff-dd62bd587bc8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168502 Sep 13 14:29:25.378074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1301/2515] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:25.487882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:25.488469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:25.494396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:25.494866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:25.495289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:25.495963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:25.496404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:25.496820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:25.621863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:25.630109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-761acbc6-255c-42c1-b856-afb82e76aa7e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.146738 Sep 13 14:29:25.630672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1215/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:25 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:26.391386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:26.391991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:26.399398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:26.399808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:26.400238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:26.400914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:26.401362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:26.401804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:26.402587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:26.403200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:26.409586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:26.410211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:26.410645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:26.411332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:26.411783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:26.412206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:26.539597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:26.550041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:26.556739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc2cf76b-e751-41bb-adee-a46a360c219a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.169000 Sep 13 14:29:26.559216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1302/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:26.561178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:26.562869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:26.564071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-32745e27-055c-47c1-9372-9a38e13d61fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.165476 Sep 13 14:29:26.565148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1216/2518] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:26.653017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:26.653575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:26.659606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:26.660073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:26.660502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:26.661176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:26.661622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:26.662067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:26.786609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:26.794849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-39f4039d-daba-4edc-aab9-b1ff31f72523 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.145645 Sep 13 14:29:26.795405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1303/2519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:26 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:27.581149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:27.581972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:27.588497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:27.588975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:27.589413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:27.590140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:27.590595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:27.590708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:27.591132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:27.591429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:27.598704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:27.599189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:27.599649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:27.600371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:27.600827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:27.601257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:27.720818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:27.729563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af906473-5270-42b2-ac39-75863f924c46 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153049 Sep 13 14:29:27.730171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1217/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:27.733290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:27.741979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:27.743409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:27.744549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82fda684-b98e-4dab-939a-b54d556db3b7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158030 Sep 13 14:29:27.745093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1304/2521] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:27.818962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:27.819562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:27.825435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:27.825942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:27.826367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:27.827042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:27.827485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:27.827902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:27.956029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:27.964129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e184f9a-3fd9-420f-bdff-eaa885597940 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149535 Sep 13 14:29:27.964698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1218/2522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:27 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:28.753395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:28.754060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:28.760597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:28.761080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:28.761511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:28.762295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:28.762751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:28.763173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:28.770415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:28.771276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:28.777653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:28.778101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:28.778531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:28.779212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:28.779658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:28.780071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:28.891814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:28.900841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6b1bdb9-82cc-48f8-b889-ecee1af9b0fd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151432 Sep 13 14:29:28.901412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1305/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:28.912263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:28.920726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:28.922199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:28.923344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2c3193e-8875-436d-a6e5-79dbb7b7ca7a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157224 Sep 13 14:29:28.923921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1219/2524] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:28.986998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:28.987601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:28.993473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:28.993987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:28.994423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:28.995100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:28.995552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:28.995970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:29.125794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:29.134538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-932c3d40-734b-4cc7-a84c-871f3febddd2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151464 Sep 13 14:29:29.135105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1306/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:28 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:29.924959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:29.925522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:29.931994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:29.932468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:29.932900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:29.933579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:29.934058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:29.934482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:29.948029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:29.948774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:29.955664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:29.956147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:29.956578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:29.957265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:29.957713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:29.958160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:30.064037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:30.068040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:30.073915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4dfd7df8-d759-49fb-a6e2-5f50830f74fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153055 Sep 13 14:29:30.074550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1220/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:30.089854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:30.098788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:30.100237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:30.101392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f49e315a-1399-4446-b51a-78a396310bf0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157170 Sep 13 14:29:30.102007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1307/2527] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:30.157999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:30.158977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:30.165423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:30.165943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:30.166379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:30.167067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:30.167530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:30.167945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:30.296811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:30.304904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0dc78fd6-b2ad-408d-bf03-fe805d5b11c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150718 Sep 13 14:29:30.305459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1221/2528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:30 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:31.098758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:31.099361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:31.105641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:31.106144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:31.106569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:31.107242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:31.107687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:31.108102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:31.127102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:31.127724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:31.134127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:31.134608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:31.135040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:31.135727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:31.136180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:31.136600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:31.241234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:31.249277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0bfc9bcb-3015-4fe4-a6c0-1f4c9e0445f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154835 Sep 13 14:29:31.249863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1308/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:31.264842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:31.274196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:31.275621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:31.276762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e868e528-5ae1-41f5-8c38-c8fccdb28206 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153653 Sep 13 14:29:31.277312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1222/2530] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:31.328202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:31.328747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:31.335216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:31.335703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:31.336137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:31.336816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:31.337271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:31.337696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:31.477235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:31.480777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:31.486763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9457a7dd-528c-4bdb-ac7f-97ecffbc9137 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162030 Sep 13 14:29:31.487342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1309/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:31 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:32.273709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:32.274349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:32.280719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:32.281201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:32.281641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:32.282356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:32.282813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:32.283753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:32.302835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:32.303438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:32.310015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:32.310493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:32.310921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:32.311593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:32.312038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:32.312451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:32.417413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:32.426722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0d9b2402-2ea0-4a78-b14c-06017b8beefb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157022 Sep 13 14:29:32.427298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1223/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:32.446206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:32.454719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:32.456391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:32.457536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c14686fa-40fc-4ea0-b096-845064b7b583 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159435 Sep 13 14:29:32.458110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1310/2533] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:32.509918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:32.510524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:32.516350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:32.516823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:32.517251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:32.518003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:32.518481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:32.518895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:32.652061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:32.660892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b476c27b-8e58-486c-8e53-8c08343e4fa0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154783 Sep 13 14:29:32.661561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1224/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:32 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:33.449396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:33.450027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:33.456712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:33.457222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:33.457659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:33.458369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:33.458822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:33.459244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:33.482977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:33.483614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:33.490785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:33.491285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:33.491700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:33.492401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:33.492854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:33.493280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:33.595789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:33.604619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8a9a0a5-e0e9-4ec6-a295-0ffe74a27bb5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159000 Sep 13 14:29:33.605203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1311/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:33.633045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:33.641688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:33.643249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:33.644412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f0541d6-4545-4703-882a-7746cb0163fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.165324 Sep 13 14:29:33.644954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1225/2536] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:33.684462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:33.685102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:33.691676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:33.692152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:33.692580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:33.693291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:33.693763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:33.694174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:33.822327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:33.830709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f8940bb-4f21-466c-8641-48718287e2d3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149992 Sep 13 14:29:33.831277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1312/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:33 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:34.629629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:34.630420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:34.637171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:34.637646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:34.638105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:34.638784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:34.639233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:34.639677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:34.670505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:34.671675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:34.678125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:34.678626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:34.679053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:34.679736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:34.680183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:34.680632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:34.780647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:34.789191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a9b9497a-74fc-4422-97a9-f5767ecc9614 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.164664 Sep 13 14:29:34.789789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1226/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:34.829291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:34.839048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:34.840595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:34.841960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33c304b5-ce73-472c-a5cb-f7cb6eb85114 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.175707 Sep 13 14:29:34.842610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1313/2539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:34.862902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:34.863510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:34.869401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:34.869928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:34.870366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:34.871051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:34.871500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:34.871919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:35.005536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:35.013744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-42683d76-5170-43a5-86f8-c06228b66133 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155228 Sep 13 14:29:35.014315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1227/2540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:34 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:35.812993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:35.813535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:35.819999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:35.820545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:35.821297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:35.822031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:35.822488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:35.822912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:35.871804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:35.872954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:35.879654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:35.880203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:35.880862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:35.881679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:35.882242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:35.882776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:35.953584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:35.962534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bcdde38e-325b-4907-9f2d-4d2e2a2ff823 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153320 Sep 13 14:29:35.963097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1314/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:36.012810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:36.022207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:36.023636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:36.024792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e2b4ee6-49d9-4c97-9eba-8f3a17e6bb49 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157018 Sep 13 14:29:36.025344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1228/2542] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:36.038124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:36.038873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:36.044764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:36.045250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:36.045682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:36.046399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:36.046855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:36.047310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:36.173110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:36.181309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1beeb88a-f0ef-4b0e-9905-9df36be143ed tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147039 Sep 13 14:29:36.181897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1315/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:36 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:36.986032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:36.986867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:36.993222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:36.993692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:36.994173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:36.994827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:36.995272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:36.995686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:37.050879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:37.051707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:37.069006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:37.069611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:37.070155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:37.070961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:37.071511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:37.071940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:37.137751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:37.147140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce8e6f61-0b1f-41fa-99fd-f8b9adaa237d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.164847 Sep 13 14:29:37.147711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1229/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:37.204430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:37.205472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:37.207452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:37.214533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:37.215024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:37.215580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:37.216185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:37.216610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:37.217176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:37.217589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:37.217859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:37.218759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2dade07-0bd0-47d4-9f81-5182554ba5c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.172720 Sep 13 14:29:37.219305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1316/2545] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:37.348537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:37.356695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-508f2597-61aa-4ed9-bb00-e7ecd4233db2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156159 Sep 13 14:29:37.357263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1230/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:37 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:38.170999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:38.171608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:38.178612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:38.179099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:38.179530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:38.180212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:38.180664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:38.181087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:38.244441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:38.245176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:38.251953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:38.252289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:38.252564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:38.253258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:38.253708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:38.254158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:38.311607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:38.320004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c17e27dd-a88e-4ff8-a7f8-0392515882c7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152829 Sep 13 14:29:38.320642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1317/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:38.380888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:38.381506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:38.384127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:38.387845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:38.388333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:38.388769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:38.389471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:38.389960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:38.390391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:38.393377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:38.394999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:38.396400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-334d53e8-62ee-4061-bda1-000faa2f2d4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155667 Sep 13 14:29:38.396961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1231/2548] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:38.522743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:38.530956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3bcceb22-28cf-4e34-9690-d37f528339c0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154420 Sep 13 14:29:38.531526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1318/2549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:38 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:39.342175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:39.342779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:39.349925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:39.350393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:39.350843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:39.351515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:39.351966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:39.352381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:39.421165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:39.421752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:39.428701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:39.428948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:39.429384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:39.430104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:39.430561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:39.430982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:39.483703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:39.491916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b40889c-ce4a-4fe6-bf80-5861e1cc870f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153489 Sep 13 14:29:39.492485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1232/2550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:39.554820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:39.555568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:39.559904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:39.561506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:39.562025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:39.562470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:39.563171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:39.563630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:39.564055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:39.568775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:39.570352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:39.571623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46b4473e-fcd6-4b6d-ae74-b7cc250e17bd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154428 Sep 13 14:29:39.572257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1319/2551] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:39.690492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:39.698717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d938798c-b5ff-4da2-9451-187635eaccdd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147836 Sep 13 14:29:39.699284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1233/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:39 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:40.515355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:40.515916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:40.522602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:40.523087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:40.523524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:40.524221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:40.524680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:40.525109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:40.598610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:40.599200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:40.605704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:40.606215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:40.606649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:40.607332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:40.607779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:40.608194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:40.659224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:40.667605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca907be4-74d1-480f-90cd-c93564c96555 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156178 Sep 13 14:29:40.668172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1320/2553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:40.723011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:40.723717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:40.729630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:40.730148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:40.730583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:40.731279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:40.731722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:40.732146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:40.741435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:40.750073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:40.751518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:40.752831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a6955bc-079e-4afa-bb27-53cc32245d36 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158882 Sep 13 14:29:40.753380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1234/2554] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:40.860792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:40.869528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48bf0e20-79c1-49a1-936b-e4606c790f3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150937 Sep 13 14:29:40.870124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1321/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:40 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:41.692134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:41.692727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:41.699098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:41.699567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:41.700001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:41.700677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:41.701122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:41.701537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:41.778164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:41.778720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:41.781164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=80 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:41.786536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:41.787018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:41.787448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:41.788142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:41.788591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:41.789007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:41.832326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:41.840655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8db9238-618b-4ed2-a3d4-f1de93958b1d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152894 Sep 13 14:29:41.841230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1235/2556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:41.892722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:41.893424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:41.899529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:41.900095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:41.900517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:41.901204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:41.901647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:41.902088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:41.921505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:41.930587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:41.932024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:41.933173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bdabf866-8b6b-4d85-8080-2cc700f9cc1e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158967 Sep 13 14:29:41.933769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1322/2557] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:42.031846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:42.041138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b7ceb40-99c4-43b9-a59e-e705b531b15f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152316 Sep 13 14:29:42.041758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1236/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:41 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:42.864596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:42.865213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:42.871776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:42.872262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:42.872699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:42.873388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:42.873876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:42.874311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:42.958999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:42.959620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:42.966060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:42.966543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:42.966984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:42.967679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:42.968138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:42.968564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:42.988514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:43.006272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:43.014595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fff4a91a-02b1-437c-8414-8f2a314bfcb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154510 Sep 13 14:29:43.015171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1323/2559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:43.065842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:43.066456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:43.072358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:43.072852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:43.073287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:43.074005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:43.074464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:43.074889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:43.102317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:43.111897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:43.113362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:43.114571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d5df6d2-c545-4261-9013-1267fe6f794e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159782 Sep 13 14:29:43.115329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1237/2560] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:43.204711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:43.213440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fefc5bff-bb6b-46dd-b6a4-9023762b3f5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151627 Sep 13 14:29:43.214036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1324/2561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:44.038027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:44.038633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:44.040909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=76 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:44.046712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:44.047198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:44.047628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:44.048322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:44.049827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:44.050260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:44.140023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:44.140626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:44.147599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:44.148084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:44.148517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:44.149195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:44.149642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:44.150086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:44.179735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:44.188591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46318903-7524-4887-bbf3-320fc947f672 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154379 Sep 13 14:29:44.196794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1238/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:44.238267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:44.239177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:44.245418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:44.245935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:44.246374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:44.247094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:44.247545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:44.247966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:44.293782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:44.304416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:44.306225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:44.307329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33552c2a-6384-42c2-b66e-d8fee748e6f1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.171315 Sep 13 14:29:44.308242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1325/2563] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:44.384733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:44.392964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-841cf97d-c611-4157-859a-b3f27b8763dc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159342 Sep 13 14:29:44.393545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1239/2564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:44 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:45.215819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:45.216457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:45.222933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:45.223412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:45.223845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:45.224523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:45.224976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:45.225398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:45.243102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:45.333143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:45.333870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:45.340409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:45.340962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:45.341456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:45.342169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:45.342645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:45.343064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:45.358138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:45.366952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a923cd46-8190-4336-abcf-1a59c1e9891a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154936 Sep 13 14:29:45.367527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1326/2565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:45.416941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:45.417164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:45.423176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:45.424306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:45.424921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:45.425673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:45.426322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:45.426768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:45.478864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:45.488868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:45.490394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:45.491567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e71212f7-4dbb-481a-9fad-caeb624a5080 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162933 Sep 13 14:29:45.492125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1240/2566] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:45.563116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:45.572099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2396d860-9f3d-4811-a06a-164af9e0338c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159579 Sep 13 14:29:45.572656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1327/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:45 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:46.390842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:46.391463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:46.398771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:46.399246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:46.399710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:46.400391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:46.400840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:46.401260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:46.520229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:46.521178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:46.529688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:46.533495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:46.534018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:46.534455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:46.535159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:46.535612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:46.536057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:46.545009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b4f98a2-72c0-479f-98c5-389326cdf022 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157915 Sep 13 14:29:46.545588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1241/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:46.594728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:46.595424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:46.601538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:46.602123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:46.602627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:46.603389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:46.603914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:46.604408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:46.679751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:46.688739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:46.690787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:46.691982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-269dd8d4-b8d8-45bb-881a-18abd9d0eb6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.176479 Sep 13 14:29:46.692700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1328/2569] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:46.739484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:46.747698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3edb41f8-d905-4d1d-96ba-efa68b1881f3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157035 Sep 13 14:29:46.748259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1242/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:46 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:47.568287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:47.568890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:47.575510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:47.575982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:47.576406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:47.577082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:47.577529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:47.577975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:47.707668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:47.715754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-735cc3db-ce1e-4cb5-959c-da100d35a37c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151613 Sep 13 14:29:47.716320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1329/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:47.717754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:47.718381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:47.725304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:47.725820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:47.726256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:47.726938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:47.727387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:47.727809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:47.772515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:47.773126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:47.779091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:47.779580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:47.780011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:47.780702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:47.781155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:47.781575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:47.855959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:47.864667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:47.866141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:47.867633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7580bd63-f470-4c5a-9ca1-fabfa917f04d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153499 Sep 13 14:29:47.868157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1243/2572] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:47.918430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:47.926484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8281c607-4a9a-42e4-8b8c-1692de916911 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158074 Sep 13 14:29:47.927099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1330/2573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:47 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:48.739996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:48.740614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:48.747011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:48.747494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:48.747929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:48.748614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:48.749070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:48.749496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:48.879356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:48.887557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b8c8423-acf3-4cd6-8d63-afe2edc42f7a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151997 Sep 13 14:29:48.888129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1244/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:48.892974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:48.893622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:48.900316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:48.900795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:48.901256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:48.901977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:48.902434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:48.902857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:48.949476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:48.950138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:48.956004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:48.956546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:48.956986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:48.957685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:48.958162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:48.958578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:49.040670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:49.051156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:49.054174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:49.056524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a7651616-0b58-4f21-9c16-f33b27ef600f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.167140 Sep 13 14:29:49.057181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1331/2575] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:49.093678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:49.103262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcaa8840-f84f-48c3-9933-876b6a8b29b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157601 Sep 13 14:29:49.105067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1245/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:49.789837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:49.790590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:49.796618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:49.797105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:49.797567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:49.799210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:49.799210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:49.799559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:49.825991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:29:49.914169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:49.915021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:49.916253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a2f07621-5e9d-476d-966a-b52600fd6379 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 204 len: 0 microversion: 2.1 time: 0.130051 Sep 13 14:29:49.917613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1332/2577] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:29:49 2022] DELETE /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:29:49.925957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:49.926447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:49.926936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:49.927706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:49.928294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:49.928717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:49.930699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:49.931569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:49.939840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:49.940415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:49.940900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:49.941718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:49.942301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:49.942854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:50.059612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:50.068541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60b8eb5b-42d2-4789-9792-2da1f1239274 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.160637 Sep 13 14:29:50.069125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1246/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:50.084171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:50.085973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:50.086803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:50.092477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82a3d652-bca2-4c26-9623-ea4d5a84d187 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.167982 Sep 13 14:29:50.092736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:50.093040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1333/2579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:50.093210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:50.093640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:50.094361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:50.094807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:50.095328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:50.130299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:50.130908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:50.136855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:50.137339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:50.138025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:50.138718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:50.139173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:50.139594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:50.226918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:50.235744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:50.238100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:50.239382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c111393b-010f-48af-9f49-fb0c8c7e60ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161752 Sep 13 14:29:50.240035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1247/2580] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:50.272819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:50.281377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-36ee08b0-a2d0-4b55-80ae-4cabdba2342c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155414 Sep 13 14:29:50.281982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1334/2581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:51.092559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:51.093104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:51.099924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.100402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.100836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.101521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.101999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.102431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.115553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:51.116160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:51.122570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.123044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.123473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.124151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.124595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.125009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.230945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:51.239271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60eb1a24-3f74-41bd-a11b-67fad0271242 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150638 Sep 13 14:29:51.240043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1248/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:51.255219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:51.263449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5af2ebec-1de1-4035-b963-a208635fd080 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151658 Sep 13 14:29:51.264010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1335/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:51.270787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:51.271661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:51.277490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.278001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.278447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.279114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.279564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.279983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.304414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:51.305158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:51.311089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.311576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.312013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.312704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:51.313158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:51.313584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:51.410594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:51.419182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:51.420635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:51.421819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96c034b2-3ef7-4b05-aa80-5fb0ad20daac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155741 Sep 13 14:29:51.422604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1249/2584] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:51.448186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:51.456537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ead8d4e7-b741-4161-a8d2-fd7d14bc4be7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155922 Sep 13 14:29:51.457109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1336/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:51 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:52.262955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:52.263562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:52.270801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.271532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.271962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.272640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.273090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.273508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.288324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:52.289028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:52.295524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.296000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.296432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.297122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.297573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.298013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.404176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:52.412887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29935250-e309-41be-b4d0-b6fb5ba29c05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153804 Sep 13 14:29:52.413459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1250/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:52.427974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:52.436120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58963943-a20b-4764-bee6-54900bb32ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151680 Sep 13 14:29:52.436681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1337/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:52.447821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:52.448417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:52.454246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.455247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.455668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.456342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.456786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.457204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.479528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:52.480143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:52.486206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.486699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.487134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.487827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:52.488294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:52.488754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:52.593594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:52.603089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:52.604549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:52.605712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66bed669-e817-4383-987e-93d8a2b5e567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161723 Sep 13 14:29:52.606294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1251/2588] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:52.621424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:52.630113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6f14e378-41cc-4460-b245-ab05930a6f8e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154451 Sep 13 14:29:52.630668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1338/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:53.435566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:53.436153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:53.442812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.443277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.443703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.444376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.444895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.445218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.460151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:53.460763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:53.467303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.467784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.468216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.468898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.469350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.469796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.575568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:53.584544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0dd24621-0589-4d8c-bc0d-949d6cafaf7b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152790 Sep 13 14:29:53.585106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1252/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:53.601518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:53.609686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e79a627-fbce-4557-9aff-320b631262b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153365 Sep 13 14:29:53.610262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1339/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:53.631459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:53.632056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:53.637961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.638433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.638859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.639527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.639973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.640387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.653505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:53.654139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:53.660048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.660588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.661032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.661717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:53.662196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:53.662623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:53.776622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:53.785653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:53.787282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:53.788481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bdd6d4e3-8760-4269-9f40-16ad4fd59ff6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160918 Sep 13 14:29:53.789219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1253/2592] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:53.794830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:53.803786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7924f3a9-603e-4ef6-8013-5fee0e53fe79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154079 Sep 13 14:29:53.804340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1340/2593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:53 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:54.608288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:54.608923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:54.615687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.616165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.616595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.617280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.617755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.618183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.622074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:54.633812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:54.634428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:54.640770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.641252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.641687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.642401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.643350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.643775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.663381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:29:54.758176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:54.766383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-75322d88-0d60-4de1-a9cd-454fe5766e4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.162057 Sep 13 14:29:54.766954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1254/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:54.783967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:54.792167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f348030-a083-4b38-8773-fa7d25283ef7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.163110 Sep 13 14:29:54.792730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1341/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:54.815526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:54.816124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:54.822008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.822571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.823031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.823684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.824126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.824743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.827462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:54.828036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:54.834788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.835525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.836138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.837072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:54.837701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:54.838317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:54.966637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:54.974466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:54.975861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:54.977320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:54.978514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e409001d-c15c-4845-a1fb-45aec65dbda6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168382 Sep 13 14:29:54.979086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1255/2596] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:54.982663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1e5b6055-d508-499f-9d90-cf27c24afdb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158924 Sep 13 14:29:54.983213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1342/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:55.791441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:55.791955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:55.798436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:55.798911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:55.800005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:55.800695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:55.801147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:55.801570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:55.814913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:55.816046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:55.822719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:55.823210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:55.823642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:55.824332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:55.824787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:55.825208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:55.947142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:55.956056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8eeb3746-53e0-4486-b459-0ada95b27820 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.168020 Sep 13 14:29:55.956634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1256/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:55.962811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:55.971779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8e099762-8ddd-4156-809b-0337fd872d77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160172 Sep 13 14:29:55.972537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1343/2599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:56.004349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:56.004954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:56.008678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:56.009369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:56.010844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:56.011323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:56.012343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:56.013040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:56.013491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:56.013972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:56.015195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:56.015670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:56.016099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:56.016775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:56.017221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:56.017637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:56.143806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:56.144147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:56.152601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7fe0e00b-69fc-4622-8167-205793c2a3a6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148341 Sep 13 14:29:56.152814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:56.153168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1344/2600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:56.154421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:56.155644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0feb937d-accf-43de-993c-728b366dcabf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155395 Sep 13 14:29:56.156280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1257/2601] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:29:56.980094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:56.980690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:56.987144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:56.987620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:56.988049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:56.988748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:56.989375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:56.989991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:56.994526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:56.995136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:57.001306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:57.001803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:57.002790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:57.003498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:57.005256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:57.005256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:57.133719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:57.142432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7618e148-70ba-4f1f-82d1-292fe59075ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.166091 Sep 13 14:29:57.143178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1345/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:57.143653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:57.152386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09f944fc-a1b2-4ac8-ac48-5270e333601d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.161541 Sep 13 14:29:57.153033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1258/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:57.176625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:57.177340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:57.180097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:57.180695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:57.183642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:57.184201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:57.184710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:57.185474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:57.186050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:57.186430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:57.186595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:57.186903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:57.187324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:57.187999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:57.188444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:57.188846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:57.319579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:57.321319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:57.328206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:57.329440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eefd1ef4-7797-4057-8666-4c3c48857eb4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157638 Sep 13 14:29:57.329643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:57.330041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1346/2604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:57 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:57.331395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb0657e9-0630-4bf3-b304-ca4717fb6601 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155056 Sep 13 14:29:57.331937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1259/2605] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:58.165711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:58.166337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:58.172637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.173111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.173537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.174844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.175289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.175710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.176432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:58.177199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:58.183894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.184405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.184842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.185544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.186028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.186453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.303772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:58.312153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ae9a4ac-a561-4a0a-8eaf-19c3a8c3f25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150162 Sep 13 14:29:58.312719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1347/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:58.313877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:58.323018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64f13fd0-5e35-4042-ac5a-e7254a9fe86e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151166 Sep 13 14:29:58.323572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1260/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:58.353067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:58.353667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:58.355983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:58.356594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:58.359683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.360160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.360589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.361272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.362321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.362763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.362923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.363403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.363836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.364557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:58.365009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:58.365429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:58.495448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:58.495627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:58.504328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4011380f-9eb3-473a-83fd-6678efe89fb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155151 Sep 13 14:29:58.504556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:58.504993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1348/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:58 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:58.506061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:58.507221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46e46c1e-776b-4381-b158-7559297c3d20 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155007 Sep 13 14:29:58.507771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1261/2609] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:29:59.337181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:59.337755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:59.344415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.344895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.345325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.345664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:59.346700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.347002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:59.347162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.347587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.354045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.354532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.354967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.355662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.356120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.356548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.477638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:59.486551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0cd0a83-ff16-4618-8005-72d4556db0de tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153212 Sep 13 14:29:59.486702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:59.487137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1349/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:59.494765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43a0dc1e-9394-484b-be39-2406ef865b40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152870 Sep 13 14:29:59.495320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1262/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:29:59.529300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:59.529300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:59.534358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.534835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.535265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.535395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:29:59.535953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.536094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:29:59.536403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.536826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.542056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.542539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.542972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.543666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:29:59.544119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:29:59.544542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:29:59.668440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:59.677700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ffe3a839-feb6-47a8-b557-abe97f5691b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153726 Sep 13 14:29:59.678311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1350/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:29:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:29:59.678724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:59.687617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:59.689068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:29:59.690906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-174c94a6-40f7-4b63-b273-4515a8c66a8a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160059 Sep 13 14:29:59.691466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1263/2613] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:29:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:00.510658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:00.511264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:00.518707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.518998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:00.519469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.519582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:00.519688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.520807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.521511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.521955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.526129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.526497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.526922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.527611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.528438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.528862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.652707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:00.655867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:00.661751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b8d8e90-895e-4396-800f-21ca8a2b35f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154839 Sep 13 14:30:00.662429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1351/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:00.665510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a9dcb13-0c43-40cf-8145-f3b8d5b45108 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151003 Sep 13 14:30:00.666189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1264/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:00.700379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:00.700983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:00.707571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.708046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.708478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.709155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.709656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.710064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.715032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:00.715646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:00.721866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.722390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.723015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.723709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:00.724152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:00.724575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:00.840542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:00.848687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fcb4c30a-ead1-471d-b6f0-263e59cf7fce tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152226 Sep 13 14:30:00.849259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1352/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:00 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:00.853219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:00.861883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:00.863391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:00.864607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-998048b1-8245-4903-a48e-9bb41f8febc7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153463 Sep 13 14:30:00.865236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1265/2617] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:01.685195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:01.685825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:01.688812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:01.689434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:01.692636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.693127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.693560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.694286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.694741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.695166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.696051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.696534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.696971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.697662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.698156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.698582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.829678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:01.829969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:01.838700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d85efd4-8c21-4eda-bec5-2a6caf234c4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157763 Sep 13 14:30:01.838898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fba050aa-f8b4-4bfe-9cbc-e0b6c7d30919 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153705 Sep 13 14:30:01.839473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1353/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:01.839616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1266/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:01.871532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:01.872129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:01.878697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.879190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.879618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.880292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.880737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.881154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.889840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:01.890438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:01.896443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.896923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.897347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:01.898044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:01.898487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:01.898898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:02.012563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:02.021962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97a9f565-d164-4830-a5ab-e7d975b32bb7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154042 Sep 13 14:30:02.022537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1267/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:02.030137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:02.038864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:02.040299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:02.041430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db011eeb-f121-4fef-b989-494559f61c9c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155358 Sep 13 14:30:02.042005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1354/2621] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:02.862202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:02.862846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:02.865861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:02.866476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:02.869266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:02.869758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:02.870179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:02.870911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:02.871327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:02.871743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:02.872865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:02.873342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:02.873798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:02.874676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:02.875138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:02.875562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:03.003584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:03.006513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:03.011995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a427508a-7b14-41c5-91e8-67754e54960f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153745 Sep 13 14:30:03.012567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1268/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:03.014695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb8a8d59-2b0b-460d-82d6-4b7f2e337568 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152563 Sep 13 14:30:03.015245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1355/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:03.044038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:03.044635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:03.050601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:03.051071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:03.051496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:03.052169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:03.052612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:03.053026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:03.067463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:03.068001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:03.073864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:03.074342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:03.074768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:03.075446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:03.075891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:03.076306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:03.181023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:03.189030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-00a07f23-7905-461a-a164-d0464c3daf3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148658 Sep 13 14:30:03.190159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1269/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:03 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:03.207011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:03.215570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:03.217017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:03.218190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9caa7df1-5006-4fab-96be-cf2e2d7f0f5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155205 Sep 13 14:30:03.218742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1356/2625] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:04.036623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:04.037224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:04.038855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:04.039474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:04.043761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.044235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.044662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.045347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.045815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.045951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.046238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.046421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.046854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.047542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.047997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.048420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.175364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:04.178863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:04.179044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:04.184720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b8810dd7-0525-4c24-8dbe-24b724bd3184 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152667 Sep 13 14:30:04.185302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1270/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:04.187317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-16896fa3-d7df-4675-b9c0-aedcf9737f9b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152311 Sep 13 14:30:04.187880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1357/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:04.212372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:04.213002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:04.218852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.219327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.219759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.220529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.221606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.222057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.243187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:04.243825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:04.249661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.250174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.250608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.251291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:04.251741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:04.252227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:04.256388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:04.357269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:04.370980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6c0fa62d-60fa-4284-a42e-a5dd1f3fc1ff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162366 Sep 13 14:30:04.371750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1271/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:04 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:04.386930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:04.396488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:04.397970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:04.399118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b64914cc-b0d8-409b-a87c-17723bd381f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159852 Sep 13 14:30:04.399864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1358/2629] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:05.208041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:05.208650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:05.209766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:05.210388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:05.215164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.215634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.216058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.216675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.216796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.217161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.217296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.217569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.217679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.218323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.218767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.219193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.346938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:05.348170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:05.355499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1324aeb4-db21-4710-958a-0225b51f19d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149653 Sep 13 14:30:05.356071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1359/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:05.356462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-624af4ed-1f85-4a1d-b1ab-f35e1e1513e5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152334 Sep 13 14:30:05.357028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1272/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:05.395108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:05.395710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:05.401807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.402295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.402724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.403757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.403894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.404323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.425429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:05.426127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:05.432157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.432640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.433155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.433949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:05.434468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:05.434891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:05.547108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:05.555876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-afa6fa83-07a0-4e4b-87a1-9bd18933fd7b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.164637 Sep 13 14:30:05.556444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1360/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:05.576521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:05.585485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:05.586955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:05.588102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-62916fc6-5a16-4ed5-854c-740bdeb9b5dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.167493 Sep 13 14:30:05.588657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1273/2633] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:06.380285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:06.380899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:06.387685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.388115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:06.388556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.388690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.388814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:06.389309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.389775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.390200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.395605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.396329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.396753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.397436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.397907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.398323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.524858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:06.530869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:06.537311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1fd5f0bb-dcfb-4544-be72-708fa9fdb14c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.161311 Sep 13 14:30:06.540869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1361/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:06.541043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4a9f602-f90d-4dbe-be01-d7df63210b5b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155773 Sep 13 14:30:06.541043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1274/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:06.579115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:06.579719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:06.585775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.586256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.586682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.587355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.587799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.588213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.613861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:06.614525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:06.620496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.620972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.621400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.622136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:06.622585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:06.623005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:06.722532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:06.730664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-186bc1cf-1dcb-45c1-9754-fe78122b0e49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155256 Sep 13 14:30:06.731225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1362/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:06 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:06.755729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:06.764245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:06.765673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:06.766835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a88a858-6380-458d-ad4c-d9df78b29246 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157435 Sep 13 14:30:06.767409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1275/2637] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:07.560321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:07.560980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:07.563958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:07.565255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:07.568164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.568639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.569073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.569773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.570230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.570644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.572276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.572750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.573183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.573904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.574353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.574774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.706141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:07.707231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:07.714433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d75e36f-c01d-4576-9751-2dfff0fdbee9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157995 Sep 13 14:30:07.715004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1363/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:07.715482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8bf33ff1-cc80-48f4-86ae-419ee4d722db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155472 Sep 13 14:30:07.716048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1276/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:07.753929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:07.754468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:07.760270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.760747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.761178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.761882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.762335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.762760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.792296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:07.792902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:07.798865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.799346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.799813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.800504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:07.800952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:07.801373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:07.894844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:07.903264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2a17dd9c-5d41-4b5c-baec-a2a40a7e8460 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153719 Sep 13 14:30:07.903832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1364/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:07 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:07.933051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:07.942531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:07.943975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:07.945122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c6e6c70f-9299-433d-8483-1f32e97ec280 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156648 Sep 13 14:30:07.945683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1277/2641] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:08.737539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:08.738189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:08.739099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:08.739713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:08.744691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.745168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.745594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.746136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.746304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.746613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.746745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.747050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.747158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.747769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.748222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.748645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.880726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:08.880895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:08.888928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2188faa3-6a16-424d-a50a-668dea411e9f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155851 Sep 13 14:30:08.889219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2c8d3f93-eeb8-43ac-82f5-dafec2f94035 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154151 Sep 13 14:30:08.889844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1278/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:08.894089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1365/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:08.927438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:08.928047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:08.933855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.934335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.934766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.935446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.935899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.936314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.969580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:08.970235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:08.976688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.977165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.977589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:08.978296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:08.978744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:08.979160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:09.065520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:09.073903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-731f50af-fe5d-416a-a85c-2235f01cc7bc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150894 Sep 13 14:30:09.074512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1279/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:08 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:09.107743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:09.116854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:09.118323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:09.119461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-853e9ed5-1313-47b3-a5f3-77c02900664f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153687 Sep 13 14:30:09.120015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1366/2645] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:09.912321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:09.912878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:09.913266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:09.913386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:09.919144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:09.919293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:09.919620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:09.919750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:09.920056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:09.920177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:09.920742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:09.920853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:09.921190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:09.921310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:09.921611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:09.921720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:10.055218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:10.055726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:10.063446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-975fa036-f23a-46f7-ba34-961f27fd9fc3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155081 Sep 13 14:30:10.064013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1367/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:10.064877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8be52a41-76d7-44df-9fdb-4572ade153b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156049 Sep 13 14:30:10.066051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1280/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:10.095976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:10.096572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:10.102363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:10.102836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:10.103260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:10.103931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:10.104378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:10.104791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:10.145779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:10.146804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:10.152662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:10.153134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:10.153562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:10.154267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:10.154709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:10.155129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:10.234166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:10.242830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f2d56920-d4ac-484c-a59a-52656cd55814 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150499 Sep 13 14:30:10.243394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1368/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:10 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:10.281284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:10.291075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:10.292507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:10.293647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-249f6dc5-ad2e-420e-8264-aa9efbf9d683 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152336 Sep 13 14:30:10.294226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1281/2649] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:11.087693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:11.088241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:11.088449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:11.089063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:11.090578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:11.095818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.096306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.096633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.097031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.097162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.097398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.097540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.097875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.098260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.098386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.098717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.099136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.227102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:11.233576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:11.235657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f765565-8b76-41fd-83b3-07ec1bc42e59 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150975 Sep 13 14:30:11.237027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1282/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:11.242696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5a7bdce6-2312-4784-a14e-d23b9d9afd40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158932 Sep 13 14:30:11.243251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1369/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:11.265286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:11.265930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:11.272041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.272521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.272958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.273643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.274130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.274556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.318899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:11.319580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:11.325547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.326074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.326513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.327200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:11.327656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:11.328077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:11.407422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:11.416121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20d6cd31-bf2b-4594-ac96-938c46c6de44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154524 Sep 13 14:30:11.416695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1283/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:11 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:11.457931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:11.466438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:11.467879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:11.469023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-305274f4-2372-4214-befe-d2a7f00ea7d2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154383 Sep 13 14:30:11.469570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1370/2653] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:12.259161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:12.259737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:12.265055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:12.265822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:12.266618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.267102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.268173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.269226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.269690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.270145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.272874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.273372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.273815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.274503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.274955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.275376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.398930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:12.402879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:12.407295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f466533-8ff9-4d18-976a-0b5a3087a275 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152026 Sep 13 14:30:12.407891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1284/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:12.411156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53443627-fd3e-49a2-98cb-9f9c6e153898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149827 Sep 13 14:30:12.411701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1371/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:12.439047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:12.440277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:12.446070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.446547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.446977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.447658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.448107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.448527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.495118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:12.496053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:12.502513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.503081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.503517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.504206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:12.504658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:12.505078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:12.579438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:12.587629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fdd8c86-b99e-4032-a2f6-5e7a02b6c19d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152180 Sep 13 14:30:12.588206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1285/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:12 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:12.637020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:12.645714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:12.647450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:12.648598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19e0cca3-2356-47c8-a60d-7750ac6e370c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157345 Sep 13 14:30:12.649152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1372/2657] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:13.430235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:13.430838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:13.433172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:13.433876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:13.437332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.437861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.438293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.439016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.440005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.440508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.440746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.441228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.441660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.442375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.442828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.443251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.570576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:13.572377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:13.579071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5277a2cc-0bb9-4b3d-8a8d-01b42bf7c093 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152706 Sep 13 14:30:13.579648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1286/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:13.581174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28c621b6-1c7d-4b8e-aee5-29aa603462e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151602 Sep 13 14:30:13.581742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1373/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:13.612174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:13.612292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:13.618075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.618549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.618978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.619660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.620112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.620533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.638110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:13.673454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:13.674896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:13.680801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.681209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.681635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.682340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:13.682789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:13.683215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:13.754291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:13.762461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-045a15a6-796f-4fa7-8c66-7fde7bb379ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155165 Sep 13 14:30:13.763040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1287/2660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:13 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:13.814867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:13.818251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:13.824056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:13.825505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:13.826673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1a6e155e-ef58-4af3-8ee3-84f43e137757 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157140 Sep 13 14:30:13.827220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1374/2661] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:14.602408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:14.603020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:14.604317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:14.604959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:14.605448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:14.610915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.611913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.612453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.612773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.613036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.613258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.613488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.613848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.613990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.614531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.614986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.615445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.744416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:14.748104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:14.753358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ef3cee7-b074-4f5f-a525-034f20f9cbf7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154746 Sep 13 14:30:14.753953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1288/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:14.757465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2249c94f-27cf-43dc-a229-1770d9810928 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156276 Sep 13 14:30:14.757465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1375/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:14.785418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:14.785976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:14.791697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.792169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.792594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.793267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.793708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.794148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.852473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:14.853193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:14.859235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.859815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.860243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.860972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:14.862063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:14.862559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:14.932637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:14.942026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2de9577-d2c7-4e7f-be69-3d2fdb1b0064 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160129 Sep 13 14:30:14.943000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1289/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:14 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:15.003330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:15.012021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:15.013545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:15.014839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9684b30-9ad1-49bb-9f7f-036f9dedd102 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.166143 Sep 13 14:30:15.015480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1376/2665] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:15.777153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:15.777822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:15.779674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:15.780287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:15.784244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:15.784719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:15.785142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:15.785858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:15.786309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:15.786722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:15.789320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:15.789855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:15.790302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:15.791009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:15.791487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:15.791896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:15.919206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:15.924133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:15.927455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26e80b58-4142-4b81-b28f-344fbccfb1f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154180 Sep 13 14:30:15.928038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1290/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:15.932383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ac1e1321-d35d-495f-8fb1-c37c6ca217a7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156420 Sep 13 14:30:15.932937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1377/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:15.964635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:15.965245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:15.972114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:15.972648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:15.973078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:15.973694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:15.974175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:15.974602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:16.041320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:16.042129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:16.048369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:16.049494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:16.049969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:16.050665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:16.051126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:16.051552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:16.112042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:16.120707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f336a9f-8356-4ca9-a062-7b676988c200 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159800 Sep 13 14:30:16.121480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1291/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:15 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:16.187118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:16.195724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:16.197166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:16.198336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3e4855e-d976-4819-8640-e709f095cfc2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161415 Sep 13 14:30:16.198882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1378/2669] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:16.951243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:16.951889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:16.956264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:16.956866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:16.958632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:16.959115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:16.959550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:16.960242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:16.960694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:16.961122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:16.962718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:16.963195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:16.963625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:16.964298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:16.966137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:16.966137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:17.096963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:17.105312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0c966b2e-18f1-4b5e-8bb3-683830271668 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157937 Sep 13 14:30:17.105999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1292/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:17.114510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:17.122810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-890899c5-9b61-437f-a619-18647fa42039 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.170469 Sep 13 14:30:17.123422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1379/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:17.144719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:17.145365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:17.151498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:17.151971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:17.152398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:17.153074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:17.153523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:17.153998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:17.224237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:17.224975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:17.231164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:17.231608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:17.232041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:17.232734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:17.233191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:17.233616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:17.282900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:17.291276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15aa826d-a3ef-420a-b103-6d3f8daed2a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151174 Sep 13 14:30:17.291857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1293/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:17 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:17.363663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:17.372175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:17.373594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:17.374760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8028f472-af5d-435b-913f-8e35023ebb2d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154773 Sep 13 14:30:17.375309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1380/2673] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:18.128624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:18.129236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:18.135647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.136122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.136552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.137236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.137686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.138129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.147779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:18.148691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:18.155100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.155577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.156013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.156696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.157147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.157561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.274050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:18.282133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceb464e2-bbf9-4477-8d43-45a2f55ab129 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157678 Sep 13 14:30:18.282710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1294/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:18.294621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:18.303443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-05c26d4b-7343-4075-86ad-ceafd3b3dd03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159770 Sep 13 14:30:18.304008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1381/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:18.314997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:18.315695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:18.321663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.322174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.322609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.323291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.323746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.324200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.400859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:18.401590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:18.408043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.409176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.409762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.410675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:18.411266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:18.411785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:18.462892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:18.472758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b8c80d1-bed8-4ff8-b969-e3ca773bccd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.161427 Sep 13 14:30:18.473006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1295/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:18 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:18.544685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:18.553822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:18.555269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:18.556413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8772b4f8-7d0b-4792-b426-b39ec799667d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159619 Sep 13 14:30:18.556968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1382/2677] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:19.305959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:19.306562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:19.312932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.313400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.313966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.315404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.315852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.316269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.326484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:19.327116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:19.333609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.334116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.334544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.335223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.335671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.336084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.450331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:19.458479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0de312d6-24bb-48cf-8db4-2530cf4bb29e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156358 Sep 13 14:30:19.459049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1296/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:19.469317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:19.477987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-755d5d37-0806-4284-8845-a54b5e53d3dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155211 Sep 13 14:30:19.478539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1383/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:19.495507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:19.496134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:19.502253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.502748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.503179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.503852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.504299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.504712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.582064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:19.582790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:19.588927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.589486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.590024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.590716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:19.591176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:19.591599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:19.635443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:19.643793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cabf5bf2-5a59-44a5-b5f8-6e4117ee8286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152001 Sep 13 14:30:19.644368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1297/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:19.724150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:19.732615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:19.734090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:19.735233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4bd0c05-5733-4649-81a0-4374f4ee3d25 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157595 Sep 13 14:30:19.735789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1384/2681] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:20.482000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:20.482614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:20.488994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.489467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.489949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.490629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.491094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.491501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.502287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:20.503041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:20.509774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.510269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.510736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.511452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.511911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.512335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.620280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:20.629797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ccbe787-949b-4327-8fac-ffd122a0a0d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151594 Sep 13 14:30:20.630393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1298/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:20.643163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:20.651746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c73071d-f0e8-48c4-a48a-830e92d43157 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153880 Sep 13 14:30:20.652308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1385/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:20.668205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:20.668811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:20.675597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.676096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.676524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.677210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.677659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.678111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.761650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:20.762282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:20.768304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.768780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.769212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.769957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:20.770412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:20.770832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:20.809374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:20.818354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3904b51-b09a-4e23-8933-5b586ac9e635 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153897 Sep 13 14:30:20.819156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1299/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:20 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:20.903521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:20.912115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:20.913554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:20.914731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2797569-f449-40bd-92a0-04fff28cc188 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156880 Sep 13 14:30:20.915290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1386/2685] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:21.653252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:21.653885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:21.661168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.661635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.662086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.662760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.663204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.663614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.674745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:21.675353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:21.681654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.682162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.682590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.683270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.683720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.684131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.792595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:21.801420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7449cbd4-720d-45f1-9abc-f3b5e4b431e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151965 Sep 13 14:30:21.802023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1300/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:21.814737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:21.823039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3dbbb82-b610-4e05-b640-739323be756e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152320 Sep 13 14:30:21.823598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1387/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:21.841446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:21.842078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:21.848022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.848496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.848928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.849606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.850160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.850584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.940788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:21.941392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:21.948350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.948829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.949257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.949964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:21.950415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:21.950839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:21.976444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:21.984731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc22b7fa-16ce-4e01-b017-de184df7fab4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147159 Sep 13 14:30:21.985309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1301/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:21 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:22.077932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:22.087202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:22.088632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:22.089795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc18f733-dc61-4a0d-af84-3a9482a5321e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153503 Sep 13 14:30:22.090342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1388/2689] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:22.824394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:22.824997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:22.832084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:22.832555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:22.832980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:22.833651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:22.834136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:22.834550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:22.847528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:22.848257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:22.854872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:22.855359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:22.855799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:22.856507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:22.857026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:22.857459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:22.972169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:22.980419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9df4f808-5730-4c63-b935-4680d0766af2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.159801 Sep 13 14:30:22.981180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1302/2690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:22.995351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:23.003754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3fda712-d17a-4a45-a9df-b0a3f7dfda59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.160690 Sep 13 14:30:23.004317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1389/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:23.007484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:23.008102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:23.013964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:23.014447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:23.014883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:23.015648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:23.016104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:23.016531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:23.116203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:23.116809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:23.122827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:23.123316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:23.123749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:23.124446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:23.124905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:23.125338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:23.143382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:23.151681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8318f99-1d40-4940-888b-a391a9605242 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147909 Sep 13 14:30:23.152241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1303/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:23 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:23.252001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:23.260435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:23.261922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:23.263057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-879496b1-17a8-425e-b67c-28c4d7c23c22 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150741 Sep 13 14:30:23.263604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1390/2693] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:24.003640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:24.004241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:24.010237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.010715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.011142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.011823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.012273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.012690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.016599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:24.028272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:24.028872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:24.036275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.036755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.037188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.037908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.038359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.038777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.057871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:24.145995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:24.154389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b4b9eb56-b29c-40ad-9ac0-7a1b687210d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154762 Sep 13 14:30:24.154957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1304/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:24.174393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:24.175349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:24.177612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:24.181392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.181969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.182464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.183244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.183758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.184260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.185935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cba537ff-d2c4-48e7-91e6-386104c91f66 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.161700 Sep 13 14:30:24.186505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1391/2695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:24.288940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:24.289540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:24.295387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.295869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.296294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.296970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:24.297416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:24.297861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:24.313555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:24.322763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-937521e9-3e2b-44ab-817b-56c8d24021c9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152759 Sep 13 14:30:24.323340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1305/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:24 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:24.426071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:24.434593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:24.436016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:24.437147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eddcba3f-363f-402f-8690-f9b337754f15 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152101 Sep 13 14:30:24.437702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1392/2697] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:25.178653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:25.179203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:25.185653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.186150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.186580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.187385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.187832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.188260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.210033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:25.210646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:25.217066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.217549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.218015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.218704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.219160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.219585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.316944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:25.325003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-96cc9a77-23d2-4b61-80ec-c40c3e75642b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150296 Sep 13 14:30:25.325572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1306/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:25.346839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:25.347441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:25.353128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:25.353293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.353713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.354168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.354854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.355298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.355715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.361722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-40dfb8cc-f19d-4a30-850b-06a423ffa10b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155557 Sep 13 14:30:25.362491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1393/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:25.462889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:25.463494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:25.469348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.469861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.470415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.471463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:25.471917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:25.472342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:25.488162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:25.496451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6822de21-3cee-472c-9fec-65dac52b8e81 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153997 Sep 13 14:30:25.497351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1307/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:25 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:25.601807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:25.610450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:25.612169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:25.613441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32693079-d400-409d-9211-8f2d291d3f9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154439 Sep 13 14:30:25.614128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1394/2701] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:26.349620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:26.350270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:26.356706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.357185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.357619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.358331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.358784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.359209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.385680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:26.386435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:26.393289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.393896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.394338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.395033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.395490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.395914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.490786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:26.498981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c167c1e7-83d7-44b8-a1d0-2949e825e27d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153937 Sep 13 14:30:26.499671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1308/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:26.520154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:26.520765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:26.525981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:26.527087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.527604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.528290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.528658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.529111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.529531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.536130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-00544dbd-1456-4792-9f72-4022161ac109 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154173 Sep 13 14:30:26.536795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1395/2703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:26.639692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:26.640310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:26.646380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.646863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.647286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.647966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:26.648416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:26.648833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:26.665838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:26.675129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4181ce4e-1b79-4f64-979b-55b44ba11eb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158647 Sep 13 14:30:26.675707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1309/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:26 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:27.013704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:27.022767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:27.024210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:27.025351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-16549c78-a870-4bf8-99b0-66a34ffc506c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.389978 Sep 13 14:30:27.025930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1396/2705] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:27.523225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:27.523868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:27.530540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:27.531020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:27.531455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:27.532142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:27.532596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:27.533617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:27.560155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:27.560767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:27.567419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:27.567929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:27.568358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:27.569047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:27.569495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:27.569938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:27.664352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:27.679124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08ce489f-2e70-4d05-9191-dcde2e42fe62 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.159967 Sep 13 14:30:27.680682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1310/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:27.698844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:27.699454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:27.706188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:27.706808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:27.707168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:27.707784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:27.708232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:27.708651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:27.709251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:27.717756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca15ca24-2c73-4aa1-a9eb-a2ab488a6a6e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.161400 Sep 13 14:30:27.718491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1397/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:27.837829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:27.845944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78dcbf3d-480e-4453-85b1-e43127a856ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150833 Sep 13 14:30:27.846507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1311/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:27 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:28.051263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:28.051787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:28.057661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.058171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.058603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.059277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.059728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.060151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.191686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:28.200422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:28.201916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:28.203080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c657bf4-e4c9-47bb-bb5f-fc08b98b1b3d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155805 Sep 13 14:30:28.203636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1398/2709] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:28.703542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:28.704249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:28.710808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.711281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.711714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.712398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.712933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.713252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.740934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:28.741905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:28.748406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.748883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.749312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.750053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.750530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.750947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.851977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:28.860146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4dcab088-7ffc-40bb-aab5-a720ecd067c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160424 Sep 13 14:30:28.860720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1312/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:28.868605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:28.869230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:28.875789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.876597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.876777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.878150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:28.878280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:28.878675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:28.891627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:28.900956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb9c193b-1a77-4fc5-8684-15f94adb33ed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163851 Sep 13 14:30:28.901521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1399/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:29.004656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:29.012666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-56ef15bd-3c74-4665-83cb-5512ed206a49 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147936 Sep 13 14:30:29.013230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1313/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:28 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:29.228696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:29.229308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:29.235248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:29.235731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:29.236430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:29.237148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:29.237607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:29.238063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:29.367541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:29.376152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:29.378284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:29.379440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d658b23-78df-4b15-a529-44a85e8de31c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154655 Sep 13 14:30:29.379988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1400/2713] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:29.883621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:29.884273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:29.890806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:29.891282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:29.891710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:29.892397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:29.892836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:29.893247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:29.925557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:29.926203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:29.932624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:29.933104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:29.933528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:29.934240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:29.934688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:29.935107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:30.024433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:30.034614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-caadc49a-1704-4e3e-84f6-776e9ea490c5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154536 Sep 13 14:30:30.035143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1314/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:30.039583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:30.040177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:30.046235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:30.046807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:30.047308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:30.048092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:30.049421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:30.049944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:30.071961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:30.080273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4c7cdde1-6803-4ed6-b178-9726802a3534 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159259 Sep 13 14:30:30.080850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1401/2715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:30.176814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:30.184983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23172e81-242f-497c-93ef-0fa8055eb21f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148838 Sep 13 14:30:30.185467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1315/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:30 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:30.405053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:30.405582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:30.412171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:30.412650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:30.413083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:30.413785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:30.414238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:30.414657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:30.543082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:30.551812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:30.553259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:30.554511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-215f839b-c4e6-454f-9c0f-904e9101cf7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153404 Sep 13 14:30:30.555069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1402/2717] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:31.058437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:31.059104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:31.066231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.066702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.067127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.067800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.068244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.068660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.103872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:31.104480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:31.112254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.112760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.113176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.113900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.114354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.114776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.249397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:31.259164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-766166d6-1fe1-4741-8391-8d6974680eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159028 Sep 13 14:30:31.259756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1403/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:31.264377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:31.264991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:31.272153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.272645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.273082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.273810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.274271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.274697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.410085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:31.418681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cef475f6-e8f8-449d-b61b-d0d6bbd7dc26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157877 Sep 13 14:30:31.419278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1404/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:31 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:31.446426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:31.455367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1852de72-bd93-47a2-8328-8ce23dd0d765 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.400095 Sep 13 14:30:31.455935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1316/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:31.580531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:31.581199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:31.587104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.587590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.588024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.588708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:31.589162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:31.589587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:31.718798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:31.727878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:31.729324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:31.730504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b5592567-1bc4-482b-b90d-33e71aa5231e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154545 Sep 13 14:30:31.731063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1405/2721] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:32.282917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:32.283652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:32.289964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.290443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.290873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.291555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.292005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.292434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.418235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:32.426338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a59dc88-7de1-4b9c-a191-76a645268b96 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147258 Sep 13 14:30:32.426905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1317/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:32.441981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:32.442583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:32.448851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.449327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.449771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.450446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.450892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.451308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.478049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:32.478659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:32.484641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.485117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.485549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.486312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.486764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.487183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.581739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:32.590024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a7214797-4d7f-44b5-b83f-5657de0a8f67 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152563 Sep 13 14:30:32.590598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1406/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:32 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:32.621882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:32.631031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e2e3cc5-a1d8-4400-ac56-b033d2ce27dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156933 Sep 13 14:30:32.631598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1318/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:32.756993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:32.757597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:32.763568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.764035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.764469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.765145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:32.765591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:32.766041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:32.902667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:32.911708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:32.913173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:32.914363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-49f99b17-c159-4348-a508-57f896c7faac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161240 Sep 13 14:30:32.914919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1407/2725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:33.450312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:33.450911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:33.457838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.458314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.458736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.459438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.459884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.460299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.587630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:33.595699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-193e2776-c827-4970-9169-667bbd26b848 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149295 Sep 13 14:30:33.596266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1319/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:33.612343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:33.612955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:33.619729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.620216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.620657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.621345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.621834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.622263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.626193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:33.653920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:33.654638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:33.660632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.661177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.661711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.662495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.663028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.663447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.751918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:33.761364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a754da7-b501-4e8f-bf8a-7d07fea45eb5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152908 Sep 13 14:30:33.761969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1408/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:33 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:33.791909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:33.795335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:33.800971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7369ff32-0361-4ee5-8f49-d3ec5fb10457 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150842 Sep 13 14:30:33.801605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1320/2728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:33.939051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:33.939655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:33.946494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.946980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.947417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:33.948111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:33.948570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:33.948997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.079390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:34.088914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:34.090417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:34.091591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-afc21633-12ef-41c7-820d-cb6502228797 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156369 Sep 13 14:30:34.092160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1409/2729] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:34.619819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:34.620404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:34.626886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:34.627358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:34.627783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.628457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:34.628926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:34.629609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.761404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:34.769598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4601a8fb-d87d-49c6-b78f-de7545d7d149 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153922 Sep 13 14:30:34.770816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1321/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:34.785399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:34.786581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:34.792913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:34.793398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:34.793869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.794557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:34.795012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:34.795438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.823627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:34.824541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:34.830271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:34.830754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:34.831189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.831882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:34.832911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:34.833341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:34.934626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:34.943690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58a38d77-5db9-4e0a-a8c1-062db0f89065 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162071 Sep 13 14:30:34.944268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1410/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:34 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:34.966140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:34.974291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db1abcb7-ee49-4be4-9e82-9596f825eccc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154414 Sep 13 14:30:34.974850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1322/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:35.116886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:35.117594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:35.123514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:35.123993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:35.124423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:35.125118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:35.125559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:35.126003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:35.253928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:35.262697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:35.264162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:35.265304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2367f590-c187-42fa-91e2-6e08662cbcc0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152918 Sep 13 14:30:35.265879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1411/2733] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:35.794426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:35.794980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:35.801975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:35.802456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:35.802893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:35.803582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:35.804037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:35.804504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:35.934106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:35.942520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d3c6d89-05fe-4698-b3d3-492fd6123717 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151884 Sep 13 14:30:35.943091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1323/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:35.966771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:35.967385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:35.974402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:35.974885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:35.975352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:35.976037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:35.976523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:35.976949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:35.997318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:35.997961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:36.003804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:36.004573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:36.005003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:36.005691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:36.006168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:36.006592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:36.120460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:36.134472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72615c81-e0e7-44c7-a358-2c05b77817e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.171352 Sep 13 14:30:36.135307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1412/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:35 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:36.142192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:36.150956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb24e567-2030-401d-b6e2-9ad8f9f6f9a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157400 Sep 13 14:30:36.153761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1324/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:36.291476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:36.292080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:36.297963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:36.298439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:36.298866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:36.299536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:36.299981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:36.300394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:36.427524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:36.436018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:36.437449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:36.438634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8e77a780-7145-4b2f-a642-71186bea0837 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151072 Sep 13 14:30:36.439175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1413/2737] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:36.965221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:36.965859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:36.972421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:36.973062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:36.973866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:36.974567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:36.975161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:36.975596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.102066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:37.110285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54be950f-cf17-4677-a62e-2d399b621541 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148880 Sep 13 14:30:37.111044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1325/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:37.162806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:37.163429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:37.169733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:37.170232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:37.170660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.171478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:37.171785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:37.172202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.174410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:37.175022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:37.181486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:37.182003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:37.182440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.183131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:37.183731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:37.184038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.313304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:37.322295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bb58622f-667b-4c6b-a525-3199318587ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.163238 Sep 13 14:30:37.322890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1414/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:37 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:37.324745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:37.332948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15749c23-5642-40c5-9e32-0b2cff686801 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.162241 Sep 13 14:30:37.334051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1326/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:37.463444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:37.464046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:37.469927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:37.470401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:37.470850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.471523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:37.471969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:37.472382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:37.603531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:37.612082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:37.613549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:37.615294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f6da039c-ed08-4a4f-b7a4-c5ed77367225 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155170 Sep 13 14:30:37.615852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1415/2741] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:38.134928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:38.135529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:38.141889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.142359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.142787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.143463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.143908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.144322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.273072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:38.281367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c13cdca8-0cfb-47ba-a5e5-f8d6c3b0eb70 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150948 Sep 13 14:30:38.281967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1327/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:38.344171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:38.344865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:38.351842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.352322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.352752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.353438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.353919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.354340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.364659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:38.365286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:38.371307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.371777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.372202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.372878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.373323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.373753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.487961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:38.496857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b8e87cc-816f-42a3-a6f2-4fed88c27421 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156396 Sep 13 14:30:38.499999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1416/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:38 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:38.508122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:38.516532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92d711ef-88db-4e33-96a6-14a9cffdcedf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155779 Sep 13 14:30:38.517096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1328/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:38.640462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:38.641070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:38.647629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.648113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.648549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.649235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:38.649693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:38.650140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:38.780456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:38.789391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:38.790878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:38.792030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4ae04868-2001-4f99-8bee-600f46dbde7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155486 Sep 13 14:30:38.792583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1417/2745] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:39.304560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:39.305168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:39.311523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.312001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.312432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.313138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.313589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.314037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.442673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:39.450830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ff05ae2-7ca9-46bd-918d-c11e2f3c46b0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150365 Sep 13 14:30:39.451385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1329/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:39.520480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:39.522237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:39.528884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.529367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.529831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.530542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.530995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.531417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.539975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:39.540519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:39.546649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.547727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.548159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.548851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.549301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.549780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.663086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:39.671287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8f5ac4df-302d-4441-8850-877b6ee4aefc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154607 Sep 13 14:30:39.671836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1418/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:39 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:39.681592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:39.689713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f06e1fb-0eec-4a6c-ab76-31548981cd36 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154356 Sep 13 14:30:39.690288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1330/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:39.817489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:39.818604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:39.820409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:39.825811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.826300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.826740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.827428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:39.827914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:39.828339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:39.957185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:39.966335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:39.967779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:39.968922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1eb33b47-a6e0-4234-aa0b-d9e16db6a632 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155287 Sep 13 14:30:39.969472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1419/2749] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:40.475812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:40.476495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:40.482925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:40.483406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:40.483843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:40.484532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:40.484988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:40.485415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:40.613030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:40.621197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-971bd760-a47d-439b-b345-977428a87eed tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149922 Sep 13 14:30:40.621766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1331/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:40.696166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:40.696790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:40.703169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:40.703643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:40.704071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:40.704745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:40.705211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:40.705624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:40.712751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:40.713460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:40.719425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:40.719899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:40.720328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:40.721009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:40.721451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:40.721892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:40.837154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:40.845175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ba9154a-b524-4639-82a0-f010bba50dd6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154280 Sep 13 14:30:40.845759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1420/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:40 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:40.851112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:40.859393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e9409f1-160b-41d6-804d-6937de2eeaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151078 Sep 13 14:30:40.859941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1332/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:40.994764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:40.995375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:41.001223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.001704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.002176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.002861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.003317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.003740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.131020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:41.139719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:41.141195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:41.142389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c074c677-fbbe-4f23-a40b-c102a386ef18 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151657 Sep 13 14:30:41.142982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1421/2753] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:41.645045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:41.645680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:41.652895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.653419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.653827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.654503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.654947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.655361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.784900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:41.793627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-27ce3176-a469-4704-b551-87783b6329b8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152364 Sep 13 14:30:41.794220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1333/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:41.868025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:41.868656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:41.875074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.875547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.875977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.876682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.877128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.877741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.883160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:41.883776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:41.889529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.890039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.890472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:41.891158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:41.891608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:41.892056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:42.013474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:42.023106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ebf9a55-e7d9-4d15-9bbd-113eb3790f4d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158962 Sep 13 14:30:42.023679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1422/2755] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:41 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:42.024078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:42.032459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-653c2f62-157f-4d81-a4e9-d49c14ca7670 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153666 Sep 13 14:30:42.033015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1334/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:42.167899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:42.168537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:42.174834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:42.175316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:42.175750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:42.176436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:42.176892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:42.177316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:42.304255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:42.312754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:42.314241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:42.315396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-902508f1-c172-44e2-8ba9-0adeac65ecbd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151497 Sep 13 14:30:42.315957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1423/2757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:42.816733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:42.817272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:42.823906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:42.824377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:42.824802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:42.825562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:42.826066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:42.826493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:42.955593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:42.964005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a5ed6a5-3e8f-4486-9170-9b45c1ecf925 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151183 Sep 13 14:30:42.964566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1335/2758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:43.046225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:43.046826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:43.053518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.054025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.054453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.055131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.055254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:43.055577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.055852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:43.055982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.061868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.062348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.062812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.063507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.063954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.064378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.191826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:43.193046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:43.196994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:43.200643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ec50ec6-7903-46a3-a456-f69acabbe620 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149434 Sep 13 14:30:43.201221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1336/2759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:43.202643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-77a7e032-76f8-49fb-b10c-e1a43fbc9f10 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160221 Sep 13 14:30:43.203210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1424/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:43.340327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:43.340924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:43.346807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.347279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.347705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.348376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.348822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.349848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.369079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:43.479286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:43.488110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:43.489722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:43.490894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23bea07a-1412-4d2e-979e-cfb91573dcde tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154418 Sep 13 14:30:43.491453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1337/2761] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:43.987795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:43.988425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:43.995077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.995549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.995976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:43.996647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:43.997092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:43.997506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.124966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:44.136028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3505046-9fe0-4edd-ae8c-bcac1573e0c2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152256 Sep 13 14:30:44.136597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1425/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:44.224561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:44.225195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:44.226310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:44.226991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:44.227611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:44.232895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:44.233181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:44.233483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:44.233695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:44.233946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.234171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.234653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:44.234926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:44.235100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:44.235381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:44.235516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.235932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.366772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:44.369755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:44.375012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-848b586d-a9a3-4bcd-a747-e56d5026d2e1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152611 Sep 13 14:30:44.375583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1426/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:44 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:44.378465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-361df716-ba1d-4f9d-817e-d12647157a3e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157893 Sep 13 14:30:44.379105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1338/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:44.516178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:44.516778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:44.523242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:44.523717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:44.524148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.524827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:44.525274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:44.525688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:44.659634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:44.668884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:44.670368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:44.671559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9a2d318-e4b1-4c72-ab74-3e7c87afa338 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159300 Sep 13 14:30:44.672114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1427/2765] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:45.160472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:45.161005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:45.167649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.168127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.168557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.169234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.169686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.170145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.296448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:45.304653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d6f4e14-a679-42dc-965d-b7336eefaa33 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148194 Sep 13 14:30:45.305226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1339/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:45.399936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:45.400581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:45.402331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:45.402942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:45.407251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.407729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.408158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.408659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.408825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.409136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.409266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.409565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.409715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.410276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.410775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.411136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.541673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:45.545304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:45.549922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-482ca9dc-16da-40e9-a279-64308be61725 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154908 Sep 13 14:30:45.550491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1428/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:45 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:45.553636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a6e7fc77-c96b-461b-a565-8493645e4c37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154969 Sep 13 14:30:45.554228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1340/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:45.696866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:45.697463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:45.703301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.703775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.704200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.704874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:45.705317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:45.705757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:45.834946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:45.843400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:45.844835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:45.846002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2df05b76-b25d-479c-afef-80419d9eb96b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153663 Sep 13 14:30:45.846556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1429/2769] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:46.328067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:46.328676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:46.335613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.336084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.336512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.337187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.337631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.338091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.468239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:46.476937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89065ba3-2bea-431a-a549-d170714f8e63 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152696 Sep 13 14:30:46.477506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1341/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:46.573024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:46.573629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:46.576271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:46.576886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:46.579593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.580070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.580498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.581180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.581626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.582081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.582751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.583303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.583911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.584598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.585046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.585477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.714079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:46.718008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:46.723108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6fc7fb66-646d-43d9-a453-c4ae9aaec83f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154009 Sep 13 14:30:46.723690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1430/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:46 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:46.728052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6af0b6c9-4405-412f-a927-8239c4a0c22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155651 Sep 13 14:30:46.728618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1342/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:46.872362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:46.873031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:46.878967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.879446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.879869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:46.881258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:46.881703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:46.882144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.014196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:47.023693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:47.025118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:47.026327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-be1aca46-9ba8-4725-aba8-62223e20b42b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157886 Sep 13 14:30:47.026880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1431/2773] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:47.500608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:47.501215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:47.509029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:47.509782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:47.510224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.510923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:47.511378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:47.511802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.640894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:47.649610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c3c1917-e8c3-40bb-9f6a-0c0d56e8f9f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152992 Sep 13 14:30:47.650200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1343/2774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:47.746598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:47.747162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:47.751337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:47.751951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:47.753570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:47.754081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:47.754529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.755910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:47.756539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:47.756967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.758431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:47.758914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:47.759393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.760073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:47.760531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:47.762257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:47.897213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:47.902459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:47.905802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8257e06d-8a95-4019-b9b8-0f52ffb5a176 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.163005 Sep 13 14:30:47.906489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1432/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:47 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:47.910792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce9488ec-a0e9-4553-a495-6759812a5bb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.163141 Sep 13 14:30:47.911843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1344/2776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:48.051929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:48.053243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:48.059159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.059634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.060062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.060735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.061192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.061609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.197663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:48.206081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:48.207517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:48.208656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76090094-71f6-4665-be25-109fe2f73b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160674 Sep 13 14:30:48.209199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1433/2777] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:48.671959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:48.672560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:48.679029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.679493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.679939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.680612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.681055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.681468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.810715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:48.819746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-960dcd99-83fc-4eac-8d98-4f504e5a67a8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151592 Sep 13 14:30:48.820481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1345/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:48.928184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:48.929031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:48.933981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:48.934620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:48.935316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.935824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.936234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.936911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.937361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.937803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.940800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.941346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.941812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:48.943018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:48.943479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:48.943897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:49.072409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:49.074868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:49.080909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c32d180-7e35-44ae-bd5a-e6d4fb2cca59 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156450 Sep 13 14:30:49.081478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1434/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:49.083255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c46beece-c8ea-4219-854e-301a7703e63d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153125 Sep 13 14:30:49.083900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1346/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:49.234282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:49.234882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:49.241211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:49.241678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:49.242147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:49.242815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:49.243261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:49.243673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:49.368895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:49.377620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:49.379101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:49.380422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78f9503e-b21c-44a0-85d5-9b3e2fcd5567 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.149781 Sep 13 14:30:49.381154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1435/2781] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:49.843973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:49.844575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:49.851644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:49.852115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:49.852544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:49.853219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:49.853663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:49.854108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:49.986337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:49.994785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e5c983b-ab8d-41ef-be2f-326ec88bac03 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154650 Sep 13 14:30:49.995345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1347/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:50.105563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:50.106150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:50.109388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:50.110448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:50.114639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:50.115142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:50.115577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:50.116280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:50.116730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:50.117151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:50.118114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:50.118699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:50.119245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:50.119993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:50.120506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:50.120926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:50.255805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:50.265242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:50.268496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de5207c0-8ed1-4dbd-9f2c-742c8c644510 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.165320 Sep 13 14:30:50.269495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1348/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:50.276631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d65bd245-5818-4ea8-9c64-4833e693812d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.174944 Sep 13 14:30:50.277367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1436/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:50.407003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:50.407546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:50.413774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:50.414288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:50.414724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:50.415412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:50.415859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:50.416276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:50.557781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:50.566457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:50.567971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:50.569186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8264bc5a-e779-4550-8a02-ee364bf17412 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.166966 Sep 13 14:30:50.569782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1349/2785] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:51.018731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:51.019521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:51.026758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.027234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.027664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.028353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.028802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.029240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.161547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:51.170116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-51595352-ab87-47d4-837b-bb327c5df803 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155751 Sep 13 14:30:51.170687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1437/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:51.293342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:51.293929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:51.300686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.301165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.301592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.301850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:51.302682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:51.302866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.303315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.303735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.310280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.311086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.311617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.312433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.313092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.313707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.439682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:51.445893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:51.448158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4adef0b2-c708-4d1f-b8ad-dd6fae0a7b4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158712 Sep 13 14:30:51.448731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1350/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:51.454440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b317fd3c-4ae2-4ade-a5de-01a1a20e274c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158217 Sep 13 14:30:51.455200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1438/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:51 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:51.596739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:51.597410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:51.604008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.604484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.604911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.605584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:51.606066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:51.606486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:51.748258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:51.757927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:51.759376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:51.760588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7633b6e0-cfb1-4cfd-a994-fc5717e28b5e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168076 Sep 13 14:30:51.761155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1351/2789] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:52.195097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:52.195703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:52.202113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.202594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.203029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.203710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.204165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.204584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.333755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:52.341881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9b9c83fd-b244-4aea-ba89-52e455c59027 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151173 Sep 13 14:30:52.342446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1439/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:52.475041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:52.475688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:52.477535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:52.478181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:52.482109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.482583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.483017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.483698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.484146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.484290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.484570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.484712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.485080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.485784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.486747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.486747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.619330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:52.619523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:52.627577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fe5a3d56-2174-4625-8db5-a2a6571617ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154427 Sep 13 14:30:52.627761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d0e131c0-ab21-43fb-ac8d-308740e71091 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156871 Sep 13 14:30:52.628134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1440/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:52.628308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1352/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:52.787514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:52.788125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:52.794184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.794662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.795100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.795785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:52.796350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:52.796792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:52.924495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:52.933216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:52.934670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:52.935816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d24b9364-338d-4f92-a432-7b2b5c280bfd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153100 Sep 13 14:30:52.936378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1353/2793] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:53.367148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:53.367791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:53.375087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.375570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.376003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.376684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.377150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.377553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.396902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:53.516695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:53.525460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b7bd3816-6b87-42c1-90f4-9710b820092a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163393 Sep 13 14:30:53.526439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1441/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:53.650902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:53.651478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:53.652393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:53.653077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:53.658060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.658587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.659058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.659188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.659554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.659777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.660029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.660322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.660739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.660860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.661268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.661755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.665944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:30:53.806703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:53.812819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:53.815240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92001149-79f4-4b95-a067-ab612f1588fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.168875 Sep 13 14:30:53.815819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1354/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:53 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:53.821858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08f567af-f0fa-442d-8860-5a7cf522bcf3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.174347 Sep 13 14:30:53.822418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1442/2796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:53.960674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:53.961274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:53.967384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.967856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.968284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:53.968956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:53.969401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:53.969840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.095896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:54.105124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:54.106606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:54.107744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24e8336d-6295-422b-8165-5026ff16b810 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151012 Sep 13 14:30:54.108300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1355/2797] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:54.548348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:54.548960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:54.556193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:54.556688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:54.557098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.557812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:54.558269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:54.558725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.692906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:54.701514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1826e8b8-cc73-434e-b28a-29c870425adc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156990 Sep 13 14:30:54.702133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1443/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:54.836651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:30:54.837063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 (ip 10.222.0.20) !!! Sep 13 14:30:54.841681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:54.842312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:54.844566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:54.845059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:54.849848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:54.850331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:54.850766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.851456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:54.851907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:54.852043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:54.852328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.852441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:54.852865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.853581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:54.854066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:54.854492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:54.987353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:54.987811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:54.995932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebc7bf4e-aacf-48a8-a9e5-a5ed2d9388de tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160175 Sep 13 14:30:54.996329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0069014a-583e-421b-a9c7-52e4ca273648 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155853 Sep 13 14:30:54.997049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1356/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:54.997206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1444/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:55.133378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:55.133939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:55.139821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:55.140294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:55.140728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:55.141404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:55.141880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:55.142576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:55.279706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:55.289105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:55.290635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:55.291772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c4c889b6-9933-4ded-8c4f-2eba05ee3f1c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162544 Sep 13 14:30:55.292321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1357/2801] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:30:55.725839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:55.726447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:55.732934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:55.733412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:55.733866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:55.734542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:55.735015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:55.735405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:55.864071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:55.872320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0fcd9284-1922-4d64-8942-16cf7a9a3850 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151049 Sep 13 14:30:55.872875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1445/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:56.019105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:56.019712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:56.019840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:56.019946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:56.026508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.026986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.027166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.027415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.027645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.028079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.028240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.028525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.028762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.028942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.029213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.029635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.158031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:56.166510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ccd38b68-cc5d-40c9-ba9d-3dd51783e350 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151292 Sep 13 14:30:56.166945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:56.167383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1358/2803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:56.175102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83a73f69-ef14-4051-9b3c-4f1af713562c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159734 Sep 13 14:30:56.175654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1446/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:56.316198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:56.316799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:56.323272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.323743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.324171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.324849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.325290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.325706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.458857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:56.468374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:56.469882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:56.471048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7190578-c6bc-4837-958f-6a5ca0e74e2c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158695 Sep 13 14:30:56.471796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1359/2805] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:56.894707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:56.895990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:56.902939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.903419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.903855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.904599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:56.905053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:56.905480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:56.991414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:30:56.991576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:30:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 (ip 10.222.0.20) !!! Sep 13 14:30:57.035728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:57.043983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a0e149a8-e6eb-40d2-b6b8-42790c87bdbe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153307 Sep 13 14:30:57.044540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1447/2806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:57.188513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:57.189070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:57.196098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:57.196579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:57.197012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:57.197700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:57.198177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:57.198461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:57.198621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:57.199101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:57.205048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:57.205538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:57.206020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:57.206697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:57.207148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:57.207569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:57.331692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:57.340918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39a477b5-446c-44e0-9ece-9156e86f29e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156292 Sep 13 14:30:57.342946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:57.351312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-109d3ece-11c8-414b-bcc3-d797d704e514 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156629 Sep 13 14:30:57.365265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1448/2807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:57 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:57.366051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1360/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:57.496687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:57.497301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:57.503446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:57.503932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:57.504368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:57.505671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:57.506158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:57.506582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:57.633810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:57.642237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:57.643705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:57.644880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b84e22e-efef-4ef0-ab80-edf0c141844a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152355 Sep 13 14:30:57.645477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1449/2809] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:58.067113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:58.068024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:58.074201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.074683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.075126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.075815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.076271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.076700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.210590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:58.218718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d792c2e7-96ca-4980-aefe-f10b6c7c9f52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155489 Sep 13 14:30:58.219286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1361/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:58.378074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:58.378692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:58.385609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.385957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:58.386472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:58.386990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.387524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.388533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.389213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.389823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.397843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.399389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.400042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.400954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.401663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.402323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.549347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:58.558342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-950abf44-d55a-4258-a2f4-97d5e9df7fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.184503 Sep 13 14:30:58.560010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1450/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:58.571256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:58.579464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f05d3a5-5e73-499d-858c-e6e98ccc8475 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.197412 Sep 13 14:30:58.580026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1362/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:58 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:58.671056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:58.671585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:58.678337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.678808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.679233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.679905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:58.680352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:58.680765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:58.810377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:58.819328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:58.820759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:58.821950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-18b5cb39-3f30-4bb1-ad1b-8349cf58706b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154799 Sep 13 14:30:58.822506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1451/2813] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:30:59.242072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:59.242687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:59.249220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.249746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.250190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.250880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.251333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.251758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.379542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:59.388411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff4da367-f096-4c41-b6b5-b757e972b26a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150469 Sep 13 14:30:59.388985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1363/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:59.581893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:59.582494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:59.588841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.589317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.589778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.590450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.590895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.591308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.603119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:59.603724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:59.609523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.610046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.610470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.611248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.611863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.612285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.721529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:59.730358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7b6f8a2d-0f2b-43f4-894f-66c0f5376418 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152106 Sep 13 14:30:59.731124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1452/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:30:59.744077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:59.752446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b581ac68-f536-4742-8858-3ce6764a2594 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153061 Sep 13 14:30:59.752947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1364/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:30:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:30:59.847540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:30:59.848138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:30:59.854691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.855179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.855608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.856283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:30:59.856731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:30:59.857149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:30:59.990455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:30:59.998862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:00.000308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:00.001447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c26265fd-de38-4628-a68b-f0b7742a2f72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157749 Sep 13 14:31:00.002030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1453/2817] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:30:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:00.413509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:00.414138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:00.420629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:00.421105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:00.421555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:00.422268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:00.422715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:00.423131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:00.555983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:00.564286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6696e905-710d-4609-94d2-cf28ddf41fc5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155342 Sep 13 14:31:00.564897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1365/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:00.753529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:00.754171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:00.760991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:00.761461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:00.761929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:00.762602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:00.763048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:00.763463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:00.776201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:00.776805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:00.782611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:00.783079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:00.783502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:00.784178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:00.784626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:00.785041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:00.894380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:00.905570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c5c087e-f98f-43de-9537-69cb9cf0ecd3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155779 Sep 13 14:31:00.906180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1454/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:00.921661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:00.930022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6812b97-3ef6-4624-907a-1d5c9b5dc1f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157612 Sep 13 14:31:00.930599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1366/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:00 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:01.027396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:01.028019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:01.033996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.034472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.034897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.035567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.036061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.036546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.165914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:01.174364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:01.175795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:01.177602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ac59a57a-fb72-49da-be55-ffc03f2a67f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154093 Sep 13 14:31:01.178252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1455/2821] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:01.587588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:01.588319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:01.595151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.595877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.596438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.597215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.597796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.598323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.729651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:01.737887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4325ad03-dd7e-4bdc-b596-3e4c422a7580 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154042 Sep 13 14:31:01.738453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1367/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:01.928757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:01.929307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:01.935692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.936173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.936653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.937287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.937766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.938185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.955852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:01.956753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:01.964424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.964910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.965341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:01.967393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:01.967393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:01.967843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:02.081891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:02.091263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-393f3ad1-21d4-490f-9bf4-3037bf908848 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.166522 Sep 13 14:31:02.092043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1456/2823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:02.107777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:02.116099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d7b2970-1018-43b6-813a-3dd81f3bb0fc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.165779 Sep 13 14:31:02.116670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1368/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:02.207347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:02.208120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:02.214393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:02.214975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:02.215470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:02.216230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:02.216690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:02.217112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:02.347505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:02.356546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:02.358011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:02.359155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-77365f42-110d-4270-bcb9-b1c16235be7c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155704 Sep 13 14:31:02.359714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1457/2825] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:02.760562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:02.761165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:02.767754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:02.768227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:02.768656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:02.769322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:02.769788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:02.770734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:02.907697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:02.916652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5277db2c-ce50-42f4-ae32-7d500519b2f6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159839 Sep 13 14:31:02.917223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1369/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:03.116290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:03.116825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:03.123224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.123734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.124163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.124844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.125296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.125717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.129700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:03.140059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:03.140817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:03.147091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.147566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.149288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.149288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.149288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.149603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.260475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:03.268719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3742d66b-9643-49a0-b9d3-fdce2ec59372 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157125 Sep 13 14:31:03.269369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1458/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:03.279258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:03.282621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:03.289074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e03e31a2-c8fd-4507-9450-74c27b7a71ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152796 Sep 13 14:31:03.289632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1370/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:03 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:03.384666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:03.385198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:03.391188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.391661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.392088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.392755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.393199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.393614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.522040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:03.530941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:03.532386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:03.533542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bcfdcc1b-0adc-49c5-9725-da70dc9ca5f0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152827 Sep 13 14:31:03.534141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1459/2829] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:03.940799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:03.945199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:03.950304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.950775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.951208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:03.951893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:03.952343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:03.952764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.085243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:04.093977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6b1a6fde-efdd-4096-888c-a025f4f4cc99 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157430 Sep 13 14:31:04.094555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1371/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:04.292942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:04.293565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:04.300152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:04.300632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:04.301061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.302419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:04.302868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:04.303282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.313121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:04.313896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:04.322013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:04.322627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:04.323134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.323935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:04.324468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:04.324962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.439633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:04.448412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c38af4b2-dc4a-4008-9d26-1d3c380ff871 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.159288 Sep 13 14:31:04.448976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1460/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:04.461240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:04.469404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbbae570-8260-4a42-85b5-4be13378875d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160985 Sep 13 14:31:04.469974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1372/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:04 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:04.559282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:04.559840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:04.565771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:04.566246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:04.566672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.567841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:04.568283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:04.568688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:04.695486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:04.703960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:04.705407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:04.706584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb3135b1-7c8c-46cc-9eb0-7cc2e8e90213 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151330 Sep 13 14:31:04.707135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1461/2833] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:05.117605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:05.118184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:05.124653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.125122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.125549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.126251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.126697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.127109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.259831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:05.269846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50d3c20c-03a1-476a-9a42-88691feba84a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156116 Sep 13 14:31:05.270433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1373/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:05.471930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:05.472576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:05.479049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.479531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.479964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.480649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.481112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.481538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.492838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:05.493452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:05.499524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.500139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.500765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.501454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.501930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.502348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.625765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:05.635074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8011ecd2-a725-4980-b1d8-63b0d4c1e8ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.166982 Sep 13 14:31:05.635651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1462/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:05.637515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:05.645869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7871967f-31b5-4ddc-b24b-03109fb8b6b3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157344 Sep 13 14:31:05.646839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1374/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:05.731829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:05.732374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:05.738478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.739459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.739896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.740582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:05.741036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:05.741460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:05.877506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:05.886725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:05.888181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:05.889374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a482f813-76cb-425e-aa6d-1458b7cbec3c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161414 Sep 13 14:31:05.889984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1463/2837] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:06.294212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:06.294829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:06.303274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.303756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.304191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.304876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.305331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.305778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.431632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:06.439805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d506fe73-d12d-4478-b4dd-074b6f732898 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149452 Sep 13 14:31:06.440381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1375/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:06.658626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:06.659267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:06.665831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.666314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.666748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.667434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.667888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.668310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.668433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:06.668973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:06.674984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.675440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.675867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.676759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.677240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.677656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.799861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:06.808176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9f8e9eb-8ea7-402d-81e7-a0778c5a4be1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153457 Sep 13 14:31:06.808735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1464/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:06.810479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:06.819614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edc15523-6ea8-4f94-bbc6-33112c5f9be4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155130 Sep 13 14:31:06.820170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1376/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:06 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:06.914877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:06.915486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:06.921497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.922005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.922442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:06.923140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:06.923594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:06.924011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.056016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:07.064530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:07.066011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:07.067872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6cbc191e-d84e-4e8a-8b53-4bdcb04d1343 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156281 Sep 13 14:31:07.068433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1465/2841] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:07.463599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:07.464210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:07.470831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:07.471310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:07.471744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.472432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:07.472890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:07.473962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.602028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:07.610152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5cf4e5d3-400f-4d4a-b580-0c349d4a2fa5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150404 Sep 13 14:31:07.610723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1377/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:07.831209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:07.831771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:07.838872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:07.839344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:07.839782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.840466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:07.840920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:07.841368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.842771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:07.843381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:07.850151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:07.850627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:07.851054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.851734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:07.852180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:07.852596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:07.974449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:07.983017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5731dd29-1197-4b97-a84a-bc58b27a3a0a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155640 Sep 13 14:31:07.985236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1466/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:07.992335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:08.000943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6cab480b-aca9-4a6d-8e26-79b5f8004e85 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.161959 Sep 13 14:31:08.001596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1378/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:07 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:08.092480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:08.093016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:08.099679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:08.100158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:08.100593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:08.101271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:08.101722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:08.102162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:08.230801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:08.239525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:08.240961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:08.242155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-73def73b-c8b8-46c5-840a-411a036cd3fd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153646 Sep 13 14:31:08.242709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1467/2845] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:08.634579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:08.635183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:08.641652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:08.642160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:08.642585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:08.643265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:08.643712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:08.644132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:08.772285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:08.780442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9eea56ea-4a68-440a-9507-75168c8c5f40 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149660 Sep 13 14:31:08.780946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1379/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:09.009210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:09.010033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:09.016556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.017019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.017449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.018170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.018688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.019339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.024570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:09.025222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:09.031101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.031524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.031954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.034222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.034893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.035363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.152011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:09.160566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa84a69a-f482-4dee-8459-6add8efdf2d8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156042 Sep 13 14:31:09.162036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1468/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:09.165612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:09.173921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1b5e003-4873-4aa0-99a1-adc98574fd99 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153517 Sep 13 14:31:09.174483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1380/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:09 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:09.267684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:09.268419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:09.270798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:09.276374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.276851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.277283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.278018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.278469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.278891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.405009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:09.414285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:09.415739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:09.416888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f30b3f1c-9899-43a5-8f42-ea34c6630ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153121 Sep 13 14:31:09.417446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1469/2849] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:09.804604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:09.805219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:09.811690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.812171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.812605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.813294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:09.813772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:09.814204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:09.958727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:09.966926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16c1341a-bc61-4594-8c2e-d60fd59fa262 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.167093 Sep 13 14:31:09.967495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1381/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:10.184352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:10.184989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:10.191364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.191840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.192282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:10.193204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.193660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.194117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:10.197809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:10.198423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:10.204263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.204741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.205173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:10.205896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.206349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.206765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:10.339169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:10.339359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:10.347454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19e5b03d-ce35-45f7-9868-2742d57fc526 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153469 Sep 13 14:31:10.347644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d4730069-2864-4aa7-8a69-b6ec47b5c2e9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.166894 Sep 13 14:31:10.348012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1470/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:10.348221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1382/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:10 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:10.442473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:10.443213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:10.449457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.449979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.450419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:10.451102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.451553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.451978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:10.583625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:10.592166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:10.593535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:10.594744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-50b833f9-3564-45d9-8c6e-3dfbd1c32d7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156667 Sep 13 14:31:10.595298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1383/2853] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:10.992205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:10.992817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:10.998758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:10.999242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:10.999700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.000365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.000820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.001245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.129805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:11.138359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-313320f5-0de6-443a-93a9-84e14ec52018 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150735 Sep 13 14:31:11.138906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1471/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:11.371500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:11.372049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:11.372438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:11.372563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:11.378579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.378749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.379061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.379186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.379487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.379631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.380166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.380280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.380609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.380741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.381022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.381158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.510771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:11.515016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:11.519289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c17220cf-690f-43f0-b5f6-383dfeb665e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151609 Sep 13 14:31:11.519856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1384/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:11.529983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-03192d31-b4b4-4401-bb72-be78e912018a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157343 Sep 13 14:31:11.532089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1472/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:11 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:11.620549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:11.621181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:11.627579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.627994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.628425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.629254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:11.630471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:11.630922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:11.755867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:11.764391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:11.765917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:11.766992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d890fd6b-6e0b-44e6-acc0-239464ab2f38 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150326 Sep 13 14:31:11.767548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1385/2857] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:12.162539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:12.163153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:12.168993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.169480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.169944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.170632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.171082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.171795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.307319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:12.315526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-25d3ca48-0ad1-450b-9d6f-dec4f169671c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157576 Sep 13 14:31:12.316090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1473/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:12.543480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:12.544178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:12.547984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:12.549111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:12.550956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.551440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.552222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.552989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.553448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.553916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.555730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.556206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.556634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.557310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.557795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.558231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.685610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:12.687355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:12.690791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:12.694652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2094956-2164-4e69-9666-1870194e035f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155011 Sep 13 14:31:12.695227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1386/2859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:12.697250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4cdd31bc-4002-489c-ad07-f5427d07d9b1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152963 Sep 13 14:31:12.697829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1474/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:12 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:12.792206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:12.792776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:12.798741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.799226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.799665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.800347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:12.800802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:12.801276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:12.820502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:12.929945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:12.938654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:12.940099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:12.941250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0528647a-7605-4b2c-84d6-384543ee2d0b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152995 Sep 13 14:31:12.942360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1387/2861] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:13.338881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:13.339481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:13.345358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.345869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.346297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.346966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.347411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.347822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.479621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:13.487773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da4266be-daf9-4491-a625-0d50081ab187 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152837 Sep 13 14:31:13.488320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1475/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:13.718733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:13.719455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:13.720116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:13.720736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:13.721960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:13.728160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.728383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.728649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.728867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.729081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.729296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.729795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.730010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.730249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.730463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.730678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.730879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.863833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:13.870090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:13.872199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9dc2cd75-4d67-4b61-8371-4d2958c6a430 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155794 Sep 13 14:31:13.872778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1476/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:13 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:13.878453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f8bf9f7-4ef3-4fc0-9eb6-5514d60cf5b1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.163598 Sep 13 14:31:13.879010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1388/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:13.967026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:13.967623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:13.974346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.974767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.975197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:13.975870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:13.976318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:13.976734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.106509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:14.115246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:14.116716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:14.117895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c8c25a3-043f-445f-bc3c-68a5231b7157 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154839 Sep 13 14:31:14.118455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1477/2865] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:14.512039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:14.512579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:14.518690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:14.519166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:14.519597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.520505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:14.520960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:14.521635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.652604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:14.661388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7209e204-e273-4f1c-90bf-6eabbebf57ea tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153093 Sep 13 14:31:14.662004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1389/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:14.895755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:14.896626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:14.900412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:14.901049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:14.902880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:14.903348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:14.903785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.904483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:14.904941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:14.905367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.907467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:14.907941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:14.908368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.909044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:14.909488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:14.909933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:14.925683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:31:14.925938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed (ip 10.222.0.20) !!! Sep 13 14:31:15.037649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:15.046169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-470ffed4-4937-4868-9e8f-83785bb8ba18 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154451 Sep 13 14:31:15.046748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1478/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:14 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:15.047267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:15.056335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-31a364ca-0513-449e-b862-dbe844acb8db tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160000 Sep 13 14:31:15.056905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1390/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:15.143329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:15.143869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:15.150172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:15.150648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:15.151076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:15.151751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:15.152203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:15.152621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:15.284940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:15.294457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:15.295898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:15.297042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c1b37e2-4091-4297-9903-5147da7960e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157738 Sep 13 14:31:15.297597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1479/2869] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:15.684480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:15.685018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:15.691071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:15.691551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:15.692611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:15.693315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:15.693801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:15.694232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:15.819899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:15.828158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d46dd83-918c-410c-9c79-2d6784910783 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147592 Sep 13 14:31:15.828726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1391/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:16.070338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:16.070934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:16.077131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.077654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.078127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.078700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:16.079132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.079284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.079410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:16.079705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.081646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:31:16.081844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:31:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed (ip 10.222.0.20) !!! Sep 13 14:31:16.087658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.088396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.088826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.089512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.089986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.090400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.213942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:16.222204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-67ccd406-78f1-491b-b13d-1a024dec6d5e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156448 Sep 13 14:31:16.222773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1480/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:16 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:16.226882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:16.235548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bce25c9-a42f-4027-963c-313651f729de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160518 Sep 13 14:31:16.236105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1392/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:16.322744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:16.323276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:16.329340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.329845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.330270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.330941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.331381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.331792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.460732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:16.469551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:16.471047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:16.472207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-01d587c5-19e0-4e75-9b8a-e5fe2ac93c04 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154021 Sep 13 14:31:16.472796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1481/2873] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:16.852040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:16.852646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:16.858581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.859053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.859483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.860154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:16.860596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:16.861011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:16.989818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:16.998528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b1f871cb-6eca-41cf-954a-b15125be75b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150285 Sep 13 14:31:16.999094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1393/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:17.246518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:17.247127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:17.253882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:17.254438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:17.254871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:17.255544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:17.255993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:17.256411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:17.259832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:17.266406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:17.266850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:17.267332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:17.267762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:17.268452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:17.268906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:17.269326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:17.390835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:17.399943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ecbba1d8-06e2-4c72-bc41-29d61a896e31 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158323 Sep 13 14:31:17.400713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1482/2875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:17 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:17.406643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:17.415564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87de0297-b065-4aaa-b564-6414f8958d33 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.159833 Sep 13 14:31:17.416131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1394/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:17.499469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:17.500364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:17.511235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:17.511235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:17.511669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:17.512373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:17.512831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:17.513286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:17.654866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:17.663513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:17.665706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:17.666868 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-83d2b9ac-7d56-4125-99d1-af5270920099 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.171467 Sep 13 14:31:17.667413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1483/2877] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:18.022318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:18.022931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:18.030124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.030612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.031045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.031739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.032263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.032695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.166136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:18.174460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e031093-fc72-4879-92e1-4211554bc290 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156305 Sep 13 14:31:18.175024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1395/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:18.423870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:18.424430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:18.431721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.432185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.432600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.433285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.433847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.434269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.439679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:18.440290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:18.447192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.447675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.448108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.448802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.449251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.449670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.600186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:18.601433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:18.613146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-586561f4-0c32-459d-9d9c-a8c3f3e19770 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.177454 Sep 13 14:31:18.613387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1396/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:18.616492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8c19c043-66d4-4bd7-ab7b-86aaa98ad8ca tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.196569 Sep 13 14:31:18.626285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1484/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:18 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:18.691429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:18.691958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:18.699083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.699591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.700111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.700801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:18.701248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:18.701668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:18.833673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:18.842809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:18.844303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:18.845500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-20a1581b-d34f-4264-9e1a-23d769dd1a89 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158094 Sep 13 14:31:18.846086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1397/2881] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:19.199585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:19.200261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:19.206500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.206973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.207401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.208082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.208530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.208942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.340993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:19.349518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-49a03ac7-cd05-45b6-851f-e09a73e2e376 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154603 Sep 13 14:31:19.350139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1485/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:19.636574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:19.637429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:19.644768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.645187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.645668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.646636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.647085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.647727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.649042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:19.649940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:19.657022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.657502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.657979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.658671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.659116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.659565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.796844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:19.801426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:19.807403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53d413d6-7b2c-456c-a305-a51914b6a7b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.175281 Sep 13 14:31:19.808263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1398/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:19.810866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5b503108-92fd-4ce0-93b0-becb59da4f3d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.166503 Sep 13 14:31:19.811505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1486/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:19.871513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:19.872120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:19.878518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.878995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.879422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:19.880113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:19.880557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:19.880971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.018274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:20.027496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:20.028979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:20.030190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2281abf2-3250-4121-862c-5451a39db460 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.163236 Sep 13 14:31:20.030788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1399/2885] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:20.372762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:20.373306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:20.379599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:20.380086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:20.380545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.381230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:20.381680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:20.382124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.522979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:20.533433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a491ed8b-08a7-4a3a-92a9-258883e30676 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.164668 Sep 13 14:31:20.534604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1487/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:20.832027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:20.832647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:20.834537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:20.835144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:20.839587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:20.840070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:20.840500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.841191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:20.841642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:20.842111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.842493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:20.842970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:20.843402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.844084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:20.844531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:20.844949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:20.996801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:21.006607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6e24cc8-8b25-46fd-bf58-22d5c7fc554c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.175805 Sep 13 14:31:21.007156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:21.007416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1488/2887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:20 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:21.016423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08e9474c-7c20-4b2e-b454-2cb78a752d4d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.188296 Sep 13 14:31:21.017624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1400/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:21.056934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:21.057546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:21.065560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:21.066085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:21.066543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:21.067391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:21.067849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:21.068276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:21.203747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:21.213053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:21.214527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:21.215677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54d09983-6e13-4f5f-8440-3a4933ae0c69 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.163369 Sep 13 14:31:21.216233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1489/2889] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:21.556572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:21.557170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:21.563304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:21.563757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:21.564182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:21.564855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:21.565303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:21.565718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:21.699465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:21.710435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c95bbcf2-11aa-4a97-b238-aa459e175810 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157725 Sep 13 14:31:21.711220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1401/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:22.030703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:22.031230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:22.038083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.038566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.038995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.039690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.040144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.040569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.040779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:22.041499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:22.049949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.050436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.050868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.051567 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.052019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.052441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.189970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:22.193918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:22.201594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4e2f902c-4932-499a-ac99-4ba64f2ee9a9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.174717 Sep 13 14:31:22.202485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1490/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:22 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:22.205243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d07e4f0e-2aaf-4fcc-8ebe-348ddef9d164 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.168635 Sep 13 14:31:22.206087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1402/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:22.241525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:22.242162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:22.250034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.250516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.250946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.251631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.252083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.252528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.272298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:22.394575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:22.404211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:22.405650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:22.406941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-504ca916-b18d-47eb-a035-df3b81a0e29d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.169446 Sep 13 14:31:22.407490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1491/2893] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:22.734428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:22.735037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:22.741176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.741673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.742157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.743623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:22.744086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:22.744511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:22.886905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:22.897096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb945c88-63db-4c21-9f0b-1288f077e4b6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.166420 Sep 13 14:31:22.898136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1403/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:23.224576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:23.225186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:23.228230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:23.228854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:23.231917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.232406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.232837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.233534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.234052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.234476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.235205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.235686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.236125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.236816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.237273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.237698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.241824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:23.374638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:23.375340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:23.383342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc8574e9-87fb-4a02-8417-4338b8937345 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158885 Sep 13 14:31:23.384325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06b415e5-3d7b-407d-b7a5-5a4cd8a7632a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.163029 Sep 13 14:31:23.384908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1492/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:23 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:23.385654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1404/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:23.432927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:23.433532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:23.439509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.439986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.440411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.441122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.441568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.442006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.576265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:23.585258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:23.586793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:23.587960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dee0b9ff-8c23-42fe-9afa-4aad17d6fb55 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159672 Sep 13 14:31:23.588512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1493/2897] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:23.922637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:23.923297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:23.929406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.929931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.931041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:23.932155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:23.932299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:23.932601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.068078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:24.077598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60249e3f-b9b6-44dc-be3e-19c97fcc3c21 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158785 Sep 13 14:31:24.078206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1405/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:24.408547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:24.409422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:24.409544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:24.410320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:24.416856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:24.417010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:24.417334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:24.417460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:24.417780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.417916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.418461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:24.418584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:24.418939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:24.419065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:24.419353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.419471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.558893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:24.567122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f5c9ae7-a6be-4c12-85d7-05a521e9ddff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162365 Sep 13 14:31:24.569840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1406/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:24 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:24.570148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:24.579417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c2e0b76-d2e6-4e91-8fe6-b9761d93c6c9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.174718 Sep 13 14:31:24.590514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1494/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:24.613761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:24.614372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:24.620516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:24.620996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:24.621428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.622155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:24.622606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:24.623024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:24.758091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:24.767201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:24.768633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:24.769806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d6c31108-69a9-4ca7-b534-72f05bdb6881 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160213 Sep 13 14:31:24.770414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1407/2901] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:25.102378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:25.103197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:25.109259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.109898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.110443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.111212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.111673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.112103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.244514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:25.252589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d2a825f7-ae71-4b96-8f1b-052ce4989ced tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154169 Sep 13 14:31:25.253149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1495/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:25.596765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:25.597386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:25.603642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:25.604345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:25.604493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.604975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.605404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.606118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.606562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.606974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.611118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.611716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.612231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.612993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.613454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.613912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.737351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:25.744305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:25.746335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25829c53-d22f-4677-b4ec-807b5f695647 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157484 Sep 13 14:31:25.746913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1408/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:25 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:25.752468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-295837fb-2873-4142-94a2-9047bcced44e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153211 Sep 13 14:31:25.753020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1496/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:25.796071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:25.796602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:25.802631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.803095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.803514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.804186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:25.804626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:25.805057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:25.930989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:25.939619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:25.941061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:25.942253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8d38d2bf-726e-4324-97f9-fdb18f4bd4a5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150077 Sep 13 14:31:25.942810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1409/2905] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:26.276675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:26.277274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:26.283278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.283753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.284177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.284847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.285293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.285707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.417607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:26.425670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-71d3b750-2e62-4294-b704-73e1a1f04e6a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152968 Sep 13 14:31:26.426252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1497/2906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:26.770074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:26.770724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:26.776441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:26.777043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:26.778482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.779024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.779489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.780190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.780764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.781066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.783618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.784100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.784529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.785247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.785695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.786155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.920009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:26.925628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:26.928213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd5e313d-7bc6-483e-a7d8-ad0317eab017 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162075 Sep 13 14:31:26.931498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1410/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:26 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:26.934106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d0400ae-01c9-43c8-aa70-b48aec50b48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.162395 Sep 13 14:31:26.934811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1498/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:26.968366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:26.968973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:26.974817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.975296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.975727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:26.976413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:26.977745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:26.978189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:27.105538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:27.114759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:27.116172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:27.117323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f562e7f0-ef6f-47ac-97fe-5b713a7edbd6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152750 Sep 13 14:31:27.118946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1411/2909] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:27.449597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:27.450238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:27.456175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:27.456653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:27.457079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:27.457775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:27.458225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:27.458641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:27.588548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:27.596620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-81cd0c36-9623-4d3a-95f6-b06f39e45720 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151497 Sep 13 14:31:27.597181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1499/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:27.951438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:27.952047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:27.957499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:27.958130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:27.958527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:27.959009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:27.959444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:27.960129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:27.960586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:27.961019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:27.964761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:27.965236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:27.965663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:27.966363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:27.966812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:27.967231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:28.097291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:28.100215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:28.112837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ba0d3fdb-22af-459c-b221-5c1a5ced90de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158780 Sep 13 14:31:28.113422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1500/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:28.118134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9f08cae2-97ef-42c7-8ad2-62588ea6d9b7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.170387 Sep 13 14:31:28.118904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1412/2912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:27 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:28.144023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:28.144625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:28.151450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:28.151941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:28.152377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:28.153066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:28.153662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:28.153980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:28.283152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:28.292356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:28.293816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:28.294955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0076cb9-1b88-4f4c-a6cd-0c6c3226a3be tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154644 Sep 13 14:31:28.295502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1501/2913] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:28.620831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:28.621430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:28.627310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:28.627779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:28.628203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:28.628870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:28.629318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:28.629754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:28.759166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:28.767319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3739984e-8899-41d1-97ab-9426b254359f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150921 Sep 13 14:31:28.767882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1413/2914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:29.136501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:29.137120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:29.141594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:29.142247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:29.143800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.144175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.144616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.145340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.145816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.146240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.149658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.150010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.150448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.151138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.151590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.152014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.288981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:29.292126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:29.297764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-139ea0c1-c801-431e-84a7-5a93996a3a76 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.165609 Sep 13 14:31:29.298333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1502/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:29.300462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4df72fd6-5524-4d81-b4be-c6416adac157 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.163993 Sep 13 14:31:29.301025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1414/2916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:29 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:29.324614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:29.325218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:29.331044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.331553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.331992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.332676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.333131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.333563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.463726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:29.472220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:29.473661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:29.474835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2762c2c7-7cdb-4fe9-b2cd-bfec581045e2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154726 Sep 13 14:31:29.475389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1503/2917] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:29.792069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:29.792682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:29.798656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.799137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.799575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.800259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:29.800715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:29.801135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:29.926862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:29.935786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-289f27b7-a130-4b2c-bd6b-9fddb54390af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148088 Sep 13 14:31:29.936357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1415/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:30.321087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:30.321706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:30.324725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:30.325342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:30.328466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.329019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.329459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.330246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.330703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.331150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.331715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.332220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.332656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.333347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.333827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.334252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.459530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:30.465229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:30.468603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06e8c4cf-c3f8-454a-870e-da6fd4a8b94e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152087 Sep 13 14:31:30.469179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1504/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:30.473301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03c480ba-3d5c-4513-89f7-28a8ba634885 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152788 Sep 13 14:31:30.473875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1416/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:30 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:30.500074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:30.500694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:30.506575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.507047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.507470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.508678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.509141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.509561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.635091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:30.643631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:30.645065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:30.646241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37d37104-e4af-43ac-ae77-2a83aa19aa02 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150110 Sep 13 14:31:30.647052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1505/2921] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:30.959362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:30.959971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:30.966033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.966504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.966934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:30.967611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:30.968058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:30.968478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.097347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:31.105773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb6219bb-4672-413a-b1f6-6043660344e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150221 Sep 13 14:31:31.106387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1417/2922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:31.493266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:31.494078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:31.496716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:31.497330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:31.500815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:31.501298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:31.501790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.502487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:31.502939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:31.503361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.503818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:31.504290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:31.504723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.505395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:31.505863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:31.506284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.643134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:31.652672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3af276e-0235-4607-b136-5afee9f02681 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.164202 Sep 13 14:31:31.653534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1506/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:31.660297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:31.670454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b48cc4a0-669d-4eaf-aab9-4f58dc4993ea tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.178046 Sep 13 14:31:31.671235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1418/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:31 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:31.675553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:31.676235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:31.683586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:31.684084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:31.684525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.685217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:31.685673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:31.686275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:31.815883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:31.825145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:31.826613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:31.827790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d59dd04-6b40-4336-8506-9cd48f8d4f23 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159197 Sep 13 14:31:31.828353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1507/2925] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:32.129535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:32.130212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:32.137023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.137505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.137980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.138677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.139131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.139547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.268369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:32.277374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b51b107-9cad-4122-82d9-78531c78361c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151702 Sep 13 14:31:32.277955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1419/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:32.680921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:32.681524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:32.688330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.688821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.689273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.689976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.690436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.690861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.693403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:32.694043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:32.695050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:32.701627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.702148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.702580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.703272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.703721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.704167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.825400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:32.834249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-325e22f7-8dae-4541-a7df-9aa56a1f6eb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157468 Sep 13 14:31:32.834658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1508/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:32.837432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:32.841288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:32.846903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8240e391-4a5a-4e71-9107-cc459d8b70d7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157314 Sep 13 14:31:32.847554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1420/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:32 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:32.852538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:32.853135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:32.859233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.859715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.860278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.860916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:32.861322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:32.861763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:32.991439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:33.001142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:33.002629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:33.003789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1acdfaa2-cbaa-4718-87c8-e6c349855239 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155090 Sep 13 14:31:33.004340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1509/2929] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:31:33.300597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:33.301213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:33.307969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:33.308469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:33.308907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:33.309604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:33.310094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:33.310518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:33.446540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:33.454834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a92d8dfd-81bd-4365-886a-0cb077d8d834 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158331 Sep 13 14:31:33.455410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1421/2930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:33.858898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:33.859516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:33.866011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:33.866496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:33.866938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:33.868446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:33.869101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:33.869533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:33.870765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:33.871379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:33.877780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:33.878263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:33.878695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:33.879377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:33.879833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:33.880256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:33.996951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:34.005214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-02d98ce3-675a-42e6-86fe-f5fd28cd1051 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150179 Sep 13 14:31:34.005801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1510/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:34.009653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:34.018008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-30cf3ae9-05ad-45dc-8d30-9842ff8117ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151427 Sep 13 14:31:34.018584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1422/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:33 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:34.029683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:34.030402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:34.036196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:34.036673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:34.037100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:34.037796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:34.038244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:34.038663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:34.166966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:34.175398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:34.176833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:34.178001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-789bdf44-922a-4b53-b98a-c3a1e3ab5c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152179 Sep 13 14:31:34.178555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1511/2933] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:34.478003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:34.478607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:34.484453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:34.484926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:34.485351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:34.486052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:34.486498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:34.486914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:34.620302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:34.628429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bd3f721-dedb-47c8-b611-926e1a99ad25 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154270 Sep 13 14:31:34.628983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1423/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:35.028548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:35.029193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:35.035606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.036089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.036529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.037223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.037680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.038129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.042198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:35.042802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:35.049456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.049974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.050403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.051088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.051537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.051957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.171302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:35.179549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3926fac2-b461-4e70-91e5-57008ff99490 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154763 Sep 13 14:31:35.180055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1512/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:35.182550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:35.198577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e5389925-f36e-476c-be85-006f68ccb741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160516 Sep 13 14:31:35.199390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1424/2936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:35 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:35.203542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:35.204152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:35.210190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.210675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.211741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.212480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.212936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.213356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.579710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:35.588555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:35.590020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:35.591154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-169f4ab2-a953-48d0-adbd-1ae27f6b3ec7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.391915 Sep 13 14:31:35.591707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1513/2937] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:35.652062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:35.652692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:35.658580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.659055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.659481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.660156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:35.660599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:35.661013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:35.785631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:35.794548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93488f9f-190e-4a6d-adf0-cb16335f1a29 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.146558 Sep 13 14:31:35.795108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1425/2938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:36.203262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:36.203899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:36.210273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.210745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.211683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.212349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.212793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.213209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.222676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:36.223287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:36.230368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.230850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.231283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.231976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.232431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.232852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.361228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:36.370040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-409602fd-127e-45f7-a45f-ad52883f1868 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.170519 Sep 13 14:31:36.370628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1514/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:36.609521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:36.616400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:36.617262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:36.620818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ff15e85-a087-4114-938b-e237ec6bbae5 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.401830 Sep 13 14:31:36.621407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1426/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:36 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:36.624113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.624682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.625185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.625987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.626518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.627009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.757650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:36.766613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:36.768048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:36.769184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-38a17686-3b6f-4df5-a39f-be328de6c90a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156713 Sep 13 14:31:36.769756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1515/2941] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:36.818263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:36.818798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:36.825168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.825639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.826112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.826785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:36.827232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:36.827649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:36.958373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:36.966471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ee15d50-1f09-4165-96e5-a0880fa2bad8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152017 Sep 13 14:31:36.967034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1427/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:37.397891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:37.398543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:37.404613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.405107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.405547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.406273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.406732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.407160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.530895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:37.539097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46d1f0c5-5880-4812-af05-847b8f5eec98 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148740 Sep 13 14:31:37.540161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1516/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:37.644617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:37.645220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:37.653504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.653941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.654379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.655033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.655479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.655895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.787634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:37.795042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:37.795643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:37.796441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6f8cdaaf-332d-4bc1-a19b-1db9e0615ecb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155524 Sep 13 14:31:37.797008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1428/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:37 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:37.802263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.802751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.803191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.803914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.804371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.805370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.932634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:37.941139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:37.942625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:37.943778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d10dc9f-b00d-4e41-91c1-0933a012ae40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152601 Sep 13 14:31:37.944333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1517/2945] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:31:37.989526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:37.990167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:37.996815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.997293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.997738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:37.998429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:37.998880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:37.999302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:38.123210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:38.131448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd234070-a350-46dc-9901-49a20c6027f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.145717 Sep 13 14:31:38.132021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1429/2946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:38.562768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:38.563380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:38.569905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:38.570651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:38.571211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:38.571897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:38.572348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:38.572772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:38.702216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:38.710592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da4cd0d1-5d9e-4629-9cff-47a872f53981 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151715 Sep 13 14:31:38.711670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1518/2947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:38.820164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:38.821244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:38.827646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:38.828111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:38.828537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:38.829209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:38.829653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:38.830093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:38.959691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:38.968399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-735d4bcc-2feb-4d34-bb9a-6f56a9100747 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152062 Sep 13 14:31:38.968957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1430/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:38 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:38.970056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:38.970837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:38.973712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:38.977657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:38.978180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:38.978594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:38.979273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:38.979718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:38.980133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:39.106284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:39.114746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:39.116176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:39.118174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7f08e6c8-d754-483c-bf2f-5ad0f4b0c2e6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151317 Sep 13 14:31:39.118743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1519/2949] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:31:39.155087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:39.155691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:39.161487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:39.162064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:39.162494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:39.163169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:39.163614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:39.164030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:39.288699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:39.296817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91648dd5-59f0-439d-a888-92902246708d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.145542 Sep 13 14:31:39.297383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1431/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:39.734848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:39.735491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:39.743752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:39.744259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:39.744688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:39.745369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:39.745856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:39.746274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:39.876826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:39.885583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d2c24c12-05e7-4fc7-978e-558b892e1abb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154580 Sep 13 14:31:39.886185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1520/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:39.990396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:39.991036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:39.998107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:39.998582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:39.999010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:39.999694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.000143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.000600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:40.127054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:40.136067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d7dd0795-83ee-4d58-bc9b-b5904368ef44 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149454 Sep 13 14:31:40.136627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1432/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:39 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:40.143760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:40.144367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:40.151331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.151810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.152243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:40.152926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.153377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.153827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:40.278675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:40.287148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:40.288631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:40.289901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d050037-26ac-4f0b-9b64-3bb6c669052e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.149951 Sep 13 14:31:40.290457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1521/2953] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:40.320214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:40.321504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:40.327382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.327795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.328220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:40.328896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.329341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.329781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:40.460729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:40.469513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef02beaf-5fc8-4627-8db5-a9777cad6112 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153061 Sep 13 14:31:40.470129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1433/2954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:40.909284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:40.909955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:40.916406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.916882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.917311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:40.918042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:40.918498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:40.918947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.048175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:41.057082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19bb302e-5f9a-451b-ae70-b99d73dc7043 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151568 Sep 13 14:31:41.057638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1522/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:41.160267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:41.160879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:41.167850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:41.168331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:41.168771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.169456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:41.169949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:41.170379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.295489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:41.303680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bdde531-ec1d-4398-97f6-b8d287e3fbc1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147192 Sep 13 14:31:41.304250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1434/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:41 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:41.315186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:41.315793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:41.321877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:41.322359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:41.322791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.323472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:41.323926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:41.324352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.449604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:41.458063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:41.459506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:41.460655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-192b0051-2611-4349-921f-164d93784368 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.149293 Sep 13 14:31:41.461951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1523/2957] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:41.492251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:41.492862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:41.498834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:41.499254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:41.499692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.500376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:41.500828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:41.501255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:41.630126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:41.638310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8be55d04-0414-42f5-b458-84c42f3a20fa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149943 Sep 13 14:31:41.638866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1435/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:42.080389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:42.081001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:42.087972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.088450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.088885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.089564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.090042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.090468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.216809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:42.220239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:42.225689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4594afb-405b-435c-a251-bacc4e735e83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149170 Sep 13 14:31:42.226272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1524/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:42.327524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:42.328135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:42.334530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.335003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.335441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.336111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.336691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.337234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.469155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:42.477427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-10fce2df-809b-4171-a860-24dcd4380df6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153658 Sep 13 14:31:42.478025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1436/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:42 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:42.486714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:42.487451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:42.494032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.494516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.494951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.495640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.496096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.496518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.625904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:42.634583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:42.636026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:42.637182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5f5df3e-f405-4377-831a-6bb8236733c6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154632 Sep 13 14:31:42.637755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1525/2961] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:42.663182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:42.663822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:42.670224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.670645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.671077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.671758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:42.672209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:42.672626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:42.690900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:42.802340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:42.810812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99a56fab-8b0f-4124-b11a-c26b802fdc8d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151455 Sep 13 14:31:42.811375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1437/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:43.248853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:43.249459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:43.255854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.256331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.256762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.257434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.258527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.259096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.386163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:43.394703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e8710879-99f1-4fe6-9775-6b626ad57cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149641 Sep 13 14:31:43.395274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1526/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:43.500777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:43.501352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:43.503672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:43.509078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.509602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.510080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.510762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.511213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.511631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.637894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:43.646164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd69fba7-32f1-4b5a-b3e7-6434ef600ce8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149208 Sep 13 14:31:43.646997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1438/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:43.662483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:43.663087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:43.669564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.670083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.670511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.671181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.671627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.672058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.799666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:43.808832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:43.810288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:43.811422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cc81f327-a974-48b1-afc8-8b9e6c619bad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152851 Sep 13 14:31:43.811972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1527/2965] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:43.834558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:43.835165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:43.841109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.841584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.842049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.842731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:43.843180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:43.843599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:43.970653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:43.978959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f76681b-5f95-4cbd-8b2d-151158d593e7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148215 Sep 13 14:31:43.979534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1439/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:44.419873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:44.420478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:44.426851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:44.427332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:44.427769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:44.428456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:44.428913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:44.429338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:44.557546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:44.566021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5788485a-dd73-487c-89a4-019604f022fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150054 Sep 13 14:31:44.566583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1528/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:44.672100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:44.672100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:44.678442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:44.678931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:44.679450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:44.680394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:44.680995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:44.681601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:44.811861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:44.819870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2a254265-ab21-451e-9d20-d5e83ec5327d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152735 Sep 13 14:31:44.820936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1440/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:44 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:44.836883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:44.837615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:44.843540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:44.844009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:44.844439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:44.845114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:44.845566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:44.846021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:44.974833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:44.983360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:44.984797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:44.985960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ad28adaf-552e-4686-8b58-cb4a244f598e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153586 Sep 13 14:31:44.986508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1529/2969] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:45.002058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:45.002708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:45.009230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:45.009699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:45.010147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:45.010826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:45.011268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:45.011691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:45.144212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:45.152611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1116e3d-455d-48d5-b7a7-79f87c9fa430 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154384 Sep 13 14:31:45.153176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1441/2970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:45.589922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:45.590529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:45.596925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:45.597404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:45.597879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:45.598564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:45.599014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:45.599435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:45.728477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:45.736596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ed1a341b-e94a-42c7-9221-a943891edba0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150678 Sep 13 14:31:45.737146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1530/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:45.843977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:45.844498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:45.851079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:45.852064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:45.852515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:45.853193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:45.853638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:45.854080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:45.982880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:45.990991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8223246-2bf3-4889-8351-f287f55f696e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150894 Sep 13 14:31:45.991550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1442/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:45 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:46.012113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:46.012751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:46.018580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:46.019064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:46.019498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:46.020175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:46.020628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:46.021049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:46.150796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:46.159535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:46.161020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:46.162227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-52bd46cd-4a25-4234-be5c-5d61e2ebf9ec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154445 Sep 13 14:31:46.162937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1531/2973] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:46.176099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:46.176742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:46.182998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:46.183477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:46.183917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:46.184602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:46.185052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:46.185472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:46.312071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:46.320122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ca58115-c046-44b0-9780-984fcbaf9c8a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148143 Sep 13 14:31:46.321356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1443/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:46.760715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:46.761321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:46.767441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:46.767924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:46.768357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:46.769037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:46.769488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:46.769949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:46.899252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:46.907444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-522d743f-98e0-460f-b5f3-790ecd9b3aea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151140 Sep 13 14:31:46.908005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1532/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:47.014593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:47.015194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:47.021852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.022323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.022751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.023459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.023958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.024371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.153326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:47.173996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06bbafa7-8524-451e-93e2-ead533a1662f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.163048 Sep 13 14:31:47.174579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1444/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:47 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:47.194871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:47.195558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:47.201909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.202414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.202844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.203520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.203967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.204382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.331889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:47.341205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:47.342683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:47.343834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-519d42a8-8136-47a8-a5e5-e077b74a17c3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152844 Sep 13 14:31:47.344232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:47.344700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1533/2977] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:47.344859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:47.350766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.351182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.351751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.352586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.353038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.353470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.484542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:47.493182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-225f0258-fbbd-4703-8d4a-61776cb4670f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152735 Sep 13 14:31:47.493764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1445/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:47.931282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:47.931891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:47.937854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.938332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.938757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:47.939433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:47.939882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:47.940300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.067233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:48.075437 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1c3cd945-d6df-4332-975c-537385272cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148643 Sep 13 14:31:48.076004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1534/2979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:48.198132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:48.198712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:48.205115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:48.205595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:48.206066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.206749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:48.207203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:48.207624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.337636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:48.345878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64f70b64-14a4-443c-b769-18603d7be03f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151881 Sep 13 14:31:48.346443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1446/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:48.368364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:48.368965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:48.375414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:48.375892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:48.376322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.377003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:48.377456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:48.377931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.514507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:48.517447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:48.518078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:48.524158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:48.524990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:48.525472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:48.525652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:48.525949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.526868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:48.527012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-30d3cf12-637f-4f08-a457-02d456f013bf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162532 Sep 13 14:31:48.527428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1535/2981] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:48.527861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:48.528414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:48.661424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:48.669815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-429aa896-f256-4af6-84e7-82fd49cdee68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156091 Sep 13 14:31:48.670389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1447/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:49.098538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:49.099178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:49.105438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.105942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.106379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.107063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.107516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.107937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.235679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:49.244632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0513e8ba-8a52-4e78-a1de-693f363714f2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149937 Sep 13 14:31:49.245193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1536/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:49.369185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:49.369825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:49.376167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.376647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.377077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.377816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.378268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.378688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.504374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:49.512497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3af3e139-6290-4a95-b794-e2199e8c7b48 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147920 Sep 13 14:31:49.513064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1448/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:49 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:49.552451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:49.553052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:49.560154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.560657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.561084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.561789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.562237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.562654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.692380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:49.692992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:49.693291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:49.699109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.699625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.700058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.700740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:49.701191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:49.701609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:49.702719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:49.704235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:49.705341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7045b57b-f7bd-4d19-b8dc-ce7e0cc2b5cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156953 Sep 13 14:31:49.705922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1537/2985] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:49.831814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:49.840123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e996d76-e3c8-4f85-bf8b-214097593f68 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151557 Sep 13 14:31:49.840706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1449/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:50.267791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:50.268396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:50.274590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.275064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.275488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.276380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.276836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.277255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.407414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:50.416165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-63c7054c-4dbb-4319-b5e2-cf01e4cf5a00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152332 Sep 13 14:31:50.416730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1538/2987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:50.534912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:50.535559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:50.542911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.543386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.543820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.544503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.544958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.545411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.674046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:50.682461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-836c1794-c51e-421a-935d-fdc2cfb0009e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151540 Sep 13 14:31:50.683023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1450/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:50.731644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:50.732246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:50.738622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.739110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.739541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.740225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.740678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.741132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.863571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:50.864177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:50.870751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.871242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.871672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.872403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:50.872887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:50.873129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:50.873558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:50.881577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:50.883588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:50.884736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb06d7e0-48cd-4688-bc75-b634ad392f33 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158126 Sep 13 14:31:50.885287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1539/2989] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:31:51.000316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:51.009190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1ca9bb0-127f-4d93-b5f8-a58438ae2a7d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149475 Sep 13 14:31:51.009780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1451/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:51.444241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:51.444858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:51.451930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:51.452416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:51.452855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:51.453550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:51.454029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:51.454455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:51.583531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:51.591869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b29040ce-f7c9-407b-bad1-36695b1c400b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151394 Sep 13 14:31:51.592435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1540/2991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:51.706124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:51.706730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:51.713659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:51.714161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:51.714588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:51.715260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:51.715703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:51.716120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:51.847083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:51.856043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9530adb6-31c0-4d66-9a1b-f2b367136510 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153678 Sep 13 14:31:51.856606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1452/2992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:51 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:51.910199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:51.910842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:51.917783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:51.918275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:51.918712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:51.919407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:51.919864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:51.920289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:51.938024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:52.033735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:52.034475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:52.041887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:52.042369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:52.042805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:52.043510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:52.043965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:52.044390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:52.056641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:52.066079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:52.067538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:52.068742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0f469500-4fba-43eb-a96d-219a62f91d72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162418 Sep 13 14:31:52.069304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1541/2993] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:52.179376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:52.187643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7e41dfdf-2c53-430f-a0a2-c0e5cdd6f81e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157780 Sep 13 14:31:52.188198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1453/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:52.616079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:52.616698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:52.624498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:52.624989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:52.625430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:52.626153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:52.626612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:52.627038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:52.770720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:52.779362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6b86f984-9814-402b-8366-3807403f0220 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.167758 Sep 13 14:31:52.779932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1542/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:52.879384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:52.879986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:52.887252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:52.887725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:52.888146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:52.888860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:52.889303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:52.889717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:52.895378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:31:53.023706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:53.031890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12a4840c-84c5-4680-9f3f-09487c19571d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156374 Sep 13 14:31:53.032453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1454/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:53.100290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:53.100897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:53.108511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:53.109021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:53.109457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:53.110178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:53.110630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:53.111054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:53.212582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:53.213187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:53.219100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:53.219504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:53.219934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:53.220623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:53.221076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:53.221498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:53.240392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:53.249163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:53.250628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:53.251791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c73bb862-cd50-439a-88e8-dbd937498e1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155356 Sep 13 14:31:53.252352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1543/2997] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:53.349307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:53.357461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd4e2fa9-3aee-4d88-8051-0bd9a8a40a30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149621 Sep 13 14:31:53.358086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1455/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:53.803831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:53.805103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:53.810994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:53.811469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:53.811896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:53.812571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:53.813018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:53.813433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:53.943141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:53.951666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3d54fc4-9add-4d30-b031-0ab6a9df5cd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151735 Sep 13 14:31:53.952245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1544/2999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:54.055940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:54.056458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:54.062376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.062855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.063267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.063940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.064383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.064795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.189462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:54.197631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ceff84e7-d96f-42a7-a2c1-a9e27b9c2787 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.146260 Sep 13 14:31:54.198219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1456/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:54.277126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:54.277797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:54.284121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.284600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.285034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.285711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.286187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.286609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.380438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:54.381076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:54.387446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.387918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.388343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.389027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.389471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.389938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.416226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:54.424717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:54.426176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:54.427318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ec91928-2cfa-4559-82ea-82cad5a0f34d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154604 Sep 13 14:31:54.427865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1545/3001] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:54.524233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:54.532693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5d1cbcdd-b5ee-42d1-93ec-b429e6e4a552 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155999 Sep 13 14:31:54.533263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1457/3002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:54.974122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:54.974790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:54.980733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.981209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.981637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:54.982339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:54.982787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:54.983208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.112068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:55.120652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5402804f-87c6-4c20-81af-448ade48ed41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150288 Sep 13 14:31:55.121152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1546/3003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:55.220428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:55.221069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:55.227506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:55.227987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:55.228420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.229102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:55.229552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:55.230074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.356915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:55.365005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-36005f77-23d9-4fbe-acab-fe52485fbc88 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148472 Sep 13 14:31:55.365761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1458/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:55 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:55.453720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:55.454343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:55.460670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:55.461144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:55.461575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.462277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:55.462724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:55.463141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.556824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:55.557433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:55.563545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:55.564024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:55.564456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.565141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:55.565587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:55.566034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:55.591331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:55.600415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:55.602374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:55.603538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b4bcdb6a-d1d8-4fa7-874d-3d9fee9828ac tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153767 Sep 13 14:31:55.604092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1547/3005] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:55.700253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:55.708901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ecce23e-4a88-452b-b5ef-e3e897f3d8aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156436 Sep 13 14:31:55.709398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1459/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:56.143433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:56.143973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:56.151020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.151503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.151934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.152613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.153066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.153486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.278837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:56.286992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b1d8b23c-6a61-4180-a6c5-8f384dd1a24d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147467 Sep 13 14:31:56.287558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1548/3007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:56.389656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:56.390535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:56.396825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.397244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.397701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.398404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.398850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.399263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.536252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:56.544400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb41427d-c9d2-4857-9543-990df86a4fb2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159031 Sep 13 14:31:56.544962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1460/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:56.629706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:56.630337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:56.637340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.637864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.638297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.638976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.639425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.639848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.733303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:56.734237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:56.741347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.742724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.743169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.744186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:56.744648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:56.745066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:56.784071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:56.793794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:56.795045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:56.796209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b3606c96-d269-4fa0-9d02-bc876ef0bdcb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.170438 Sep 13 14:31:56.796758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1549/3009] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:56.889795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:56.898587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb97f7e8-cad4-49f0-9863-9456cf78e774 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.169842 Sep 13 14:31:56.899404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1461/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:57.310058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:57.310670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:57.316592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.317078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.317513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.318220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.318695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.319094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.445890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:57.454909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b633cf82-dcaf-47b1-9b19-f386789f929c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148681 Sep 13 14:31:57.455533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1550/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:57.566952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:57.567505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:57.574250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.574715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.575150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.575833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.576289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.576709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.702024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:57.710252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06fe8e1c-5bb1-43a2-9ef1-0c4ffca3b77f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147238 Sep 13 14:31:57.711449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1462/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:57 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:57.822218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:57.822784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:57.828995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.829468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.829943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.830635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.831086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.831508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.922727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:57.923339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:57.930313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.930790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.931220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.931903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:57.932354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:57.932770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:57.964895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:57.973636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:57.975126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:57.976305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c0e8d019-4304-4163-bca9-9eb9c2d6bd88 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158644 Sep 13 14:31:57.976873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1551/3013] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:58.060404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:58.068405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-786a4384-dcd0-4877-96f0-404c70f3ee93 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149505 Sep 13 14:31:58.068962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1463/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:58.478939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:58.479551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:58.485475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:58.485993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:58.486423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:58.487100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:58.487550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:58.487970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:58.615538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:58.624548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4803daaa-080e-4b1d-8b21-2c90a43f90d5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149960 Sep 13 14:31:58.625113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1552/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:58.733859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:58.734442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:58.740333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:58.740808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:58.741238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:58.741996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:58.742448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:58.742955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:58.879769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:58.888226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1403758-3b71-4a4b-b3b5-3696654754fb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158398 Sep 13 14:31:58.888801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1464/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:58 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:59.001861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:59.002400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:59.009277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.009764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.010198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.010880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.011325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.011742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.092545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:59.093156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:59.099614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.100171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.100608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.101572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.102215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.102639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.142796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:59.153242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:59.155351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:59.161762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-73fa83e5-aaab-4687-8847-7be2cccef10b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158732 Sep 13 14:31:59.161762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1553/3017] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:31:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:31:59.236761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:59.245359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc3673bd-6a98-4ca7-8d3c-ffffefa632af tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156561 Sep 13 14:31:59.249900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1465/3018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:31:59.648097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:59.649067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:59.655045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.655560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.655998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.656686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.657143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.657571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.790293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:31:59.798452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d9053cf8-db5b-409c-aedd-0262799fc967 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154529 Sep 13 14:31:59.799021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1554/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:31:59.912391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:31:59.913031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:31:59.919755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.920243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.920672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:31:59.921357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:31:59.921831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:31:59.922256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.057194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:00.065308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7b33046-7932-4498-8ff0-5aa0ce6c78a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156664 Sep 13 14:32:00.065910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1466/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:31:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:00.182070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:00.182678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:00.189007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:00.189488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:00.189958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.190642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:00.191096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:00.191521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.268539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:00.269040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:00.276436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:00.276916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:00.277346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.278064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:00.278518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:00.278942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.319627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:00.328442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:00.329897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:00.331046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bffbf322-4d52-4cec-aeb1-dd03c292603a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153005 Sep 13 14:32:00.331815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1555/3021] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:00.411009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:00.419846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bc66e19-8f6c-4e3f-9d63-4c776c0d5554 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155241 Sep 13 14:32:00.420421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1467/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:00.821821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:00.822451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:00.828369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:00.828844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:00.829273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.829985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:00.830442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:00.830860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:00.962003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:00.970248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d3af6cf6-c19f-4b64-b2b2-2bc2368c1927 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152811 Sep 13 14:32:00.970895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1556/3023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:01.088464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:01.089014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:01.095024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:01.095508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:01.095947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:01.096633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:01.097120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:01.097545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:01.223039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:01.231120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-005532b8-e588-4584-9cde-7e80d2290582 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.146694 Sep 13 14:32:01.231693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1468/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:01.357142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:01.357668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:01.364015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:01.364494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:01.364923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:01.365652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:01.366129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:01.366545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:01.443862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:01.444464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:01.451053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:01.451524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:01.451954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:01.452635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:01.453084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:01.453502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:01.494925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:01.503672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:01.505122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:01.506310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1eb05557-6f1f-465e-9a9f-0724b53d4ffd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153111 Sep 13 14:32:01.506930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1557/3025] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:01.584471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:01.593090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76bc684d-e517-432a-8a1e-17d2be773a38 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153013 Sep 13 14:32:01.593657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1469/3026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:01.993256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:01.993893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:01.999861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.000342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.000770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.001450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.001919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.002339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.006383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:02.135677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:02.143717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-34b0c38c-8422-4139-88c8-178b3fb31079 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154454 Sep 13 14:32:02.144270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1558/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:02.254996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:02.255515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:02.262229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.262705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.263136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.263813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.264264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.264681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.391164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:02.394584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:02.400370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9e22e623-a30b-4a25-8c0b-ac48b2b85a56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149234 Sep 13 14:32:02.400947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1470/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:02 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:02.531529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:02.532233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:02.538711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.539309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.539797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.540479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.540929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.541345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.617337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:02.618033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:02.624502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.624978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.625411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.626137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:02.626584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:02.627002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:02.668287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:02.676930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:02.678428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:02.680094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-897d063c-26c1-4bf4-999b-6b70a19982ff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152567 Sep 13 14:32:02.680653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1559/3029] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:02.761347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:02.769546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fb88db0-56ef-450c-a6df-658f86f74b59 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156976 Sep 13 14:32:02.770147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1471/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:03.167761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:03.168368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:03.174293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.174774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.175203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.175876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.176325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.176744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.303605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:03.311888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-858abc0c-2250-40ad-a385-ad21ce82d010 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148503 Sep 13 14:32:03.312453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1560/3031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:03.422863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:03.423394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:03.429238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.429698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.430153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.430827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.431268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.431681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.560158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:03.568275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11822241-4f85-4eee-9546-b7080ac8c714 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149396 Sep 13 14:32:03.568826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1472/3032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:03 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:03.705769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:03.706389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:03.713455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.713988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.714432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.715117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.715572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.715994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.792529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:03.793366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:03.799893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.800369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.800793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.801475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:03.801954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:03.802371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:03.848566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:03.857294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:03.858770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:03.859915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5a92e846-23a8-4c51-b962-40dc02cda545 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158144 Sep 13 14:32:03.860466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1561/3033] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:03.933199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:03.941304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-164ae210-0028-4cf2-9173-9add6044117d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152680 Sep 13 14:32:03.941886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1473/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:04.334591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:04.335196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:04.341293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.341800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.342235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.342914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.343369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.343787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.469545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:04.478272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a203caf8-bd3e-4e13-b0fa-4855442b3d27 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147465 Sep 13 14:32:04.478842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1562/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:04.592156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:04.592771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:04.599161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.599720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.600172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.600858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.601875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.602320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.729341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:04.737549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9b929ec2-a3b9-4b29-8570-337c748cad07 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149345 Sep 13 14:32:04.738140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1474/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:04 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:04.886588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:04.887223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:04.893567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.894091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.894530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.895210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.895665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.896087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.965701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:04.966331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:04.972988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.973474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.973931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:04.974618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:04.975094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:04.975510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:05.039238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:05.048068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:05.049535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:05.050725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5ffdb1e1-18aa-47f2-8986-98622823fe70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168214 Sep 13 14:32:05.051286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1563/3037] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:05.112288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:05.120405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-87e154e9-1a16-4ad4-bf25-bd46316b1398 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158542 Sep 13 14:32:05.120970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1475/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:05.505295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:05.505880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:05.512791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:05.513273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:05.513723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:05.514431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:05.514884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:05.515305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:05.642900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:05.652032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eddae065-ac20-427b-9a56-bd1ed158cc82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150652 Sep 13 14:32:05.652589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1564/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:05.761222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:05.761813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:05.767930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:05.768405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:05.768837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:05.769512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:05.769991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:05.770414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:05.900063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:05.908199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94f5ab7f-4070-4445-95bc-0dc8155bf632 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151558 Sep 13 14:32:05.908762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1476/3040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:06.075334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:06.075860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:06.082277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.082755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.083183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.083880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.084329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.084746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.144481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:06.145085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:06.152230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.152709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.153144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.153865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.154317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.154737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.214888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:06.223401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:06.224831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:06.226550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f4fc90cd-9971-414b-a13b-e244b43f56f3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154555 Sep 13 14:32:06.227105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1565/3041] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:06.291316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:06.299927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d257656-12b3-4533-b5d0-2cf79af29514 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159352 Sep 13 14:32:06.300775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1477/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:06.675041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:06.675655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:06.681892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.682377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.682808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.683489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.683944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.684363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.814311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:06.823644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8abd91b4-93fe-4f27-815c-a397a90e8b82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152471 Sep 13 14:32:06.824203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1566/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:06.932126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:06.932863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:06.938968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.939446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.939880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:06.940568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:06.941016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:06.941434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.069689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:07.078626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a297625-859f-4870-9efa-fd5e5a7841e7 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150862 Sep 13 14:32:07.079200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1478/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:06 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:07.251962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:07.252572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:07.259619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:07.260100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:07.260541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.261227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:07.261686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:07.262139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.323654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:07.324310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:07.330732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:07.331219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:07.331649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.332349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:07.332805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:07.334559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.412618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:07.422043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:07.423492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:07.424654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0c6ca92b-798c-4134-befc-444c1a9c7b7f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.176671 Sep 13 14:32:07.425217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1567/3045] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:07.474300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:07.482982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b753da78-a144-455a-95ad-fb3733ef77e3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163707 Sep 13 14:32:07.483543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1479/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:07.847236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:07.847848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:07.853762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:07.854246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:07.854679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.855357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:07.855806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:07.856224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:07.986603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:07.995312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7f1c7718-3aec-4d6a-9194-3ae8a7204d10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151930 Sep 13 14:32:07.995877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1568/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:08.102226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:08.102755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:08.108623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:08.109094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:08.109521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:08.110217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:08.110665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:08.111081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:08.236874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:08.244962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46ac5d4a-08cf-439c-9d61-219f55598ea6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147186 Sep 13 14:32:08.245519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1480/3048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:08 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:08.452535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:08.453216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:08.455657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:08.461053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:08.461618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:08.462130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:08.462878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:08.463397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:08.463885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:08.506738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:08.508021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:08.515652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:08.516130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:08.516553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:08.517237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:08.517677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:08.518125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:08.602618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:08.613453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:08.614865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:08.616054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6530bd1-93c3-4c0b-824a-3535fc8b3082 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.167448 Sep 13 14:32:08.617139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1569/3049] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:08.650226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:08.658222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bd773f7-1bd5-4447-a5ad-d3273fae330f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155203 Sep 13 14:32:08.658777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1481/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:09.018078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:09.018683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:09.024973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.025448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.025912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.026587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.027036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.027450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.157685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:09.166420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2774c743-68a0-4222-88e6-430f2ce2309d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152154 Sep 13 14:32:09.166975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1570/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:09.268313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:09.268917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:09.275693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.276188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.276617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.277292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.277758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.278175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.404448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:09.412677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-818c8d27-862b-4a71-8250-9c63cad73286 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148165 Sep 13 14:32:09.413188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1482/3052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:09 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:09.641574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:09.642195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:09.649509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.650010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.650440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.651115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.651563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.651982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.680577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:09.681142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:09.687547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.688022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.688452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.689139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:09.689585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:09.690034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:09.780036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:09.788928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:09.790516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:09.791682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c6d0d52d-64b4-4e48-a3d1-da50dccfd6e5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154041 Sep 13 14:32:09.792243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1571/3053] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:09.822552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:09.830800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f00cd2ef-3d6b-44e2-ace9-91cf1c9e95a4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154351 Sep 13 14:32:09.831366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1483/3054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:10.189348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:10.189991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:10.195987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.196472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.196904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.197585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.198077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.198503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.325051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:10.333193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0eb50714-d1a2-4f91-92a5-f8cae18e759b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147648 Sep 13 14:32:10.333772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1572/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:10.436300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:10.436918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:10.442954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.443377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.443811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.444979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.445488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.445945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.578112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:10.587078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e850455e-6595-4628-ab6d-c63b891ce033 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154560 Sep 13 14:32:10.587648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1484/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:10 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:10.817690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:10.818312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:10.825411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.825929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.826358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.827033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.827481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.827898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.854559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:10.855168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:10.861509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.862021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.862454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.863142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:10.863596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:10.864016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:10.961208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:10.969747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:10.971201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:10.972353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fd5275f4-e72a-4a36-93d1-9c8da15b3008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158606 Sep 13 14:32:10.973132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1573/3057] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:10.995849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:11.004345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfb3b736-d2e3-4636-960e-24a5c59eb387 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153620 Sep 13 14:32:11.004951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1485/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:11.356768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:11.357375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:11.363341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:11.363824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:11.364256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:11.364937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:11.365404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:11.365834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:11.493219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:11.496635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:11.502279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-38fffa40-a275-42cd-9820-669f3b3a36e6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149384 Sep 13 14:32:11.502838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1574/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:11.610096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:11.610677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:11.617054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:11.617529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:11.617978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:11.618653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:11.619095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:11.619506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:11.747484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:11.755461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-167e251a-2e5e-411b-980b-ff85ffdd7e75 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149454 Sep 13 14:32:11.756025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1486/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:11 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:11.999267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:11.999893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:12.007481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.007958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.008387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.009066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.009515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.009964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.028680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:12.029281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:12.035496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.035988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.036395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.037073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.037522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.037964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.152545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:12.161909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:12.163978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:12.165377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-10222242-9f11-420b-a059-4b2c34be3f40 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.170600 Sep 13 14:32:12.166200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1575/3061] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:12.204583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:12.312785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:12.320804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe32026c-5618-4ff4-bb31-0a91cd118b18 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.296022 Sep 13 14:32:12.321358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1487/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:12.527548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:12.528571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:12.534427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.534913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.535350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.536041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.536494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.536951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.671359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:12.679588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-81d7f659-0a7f-42cc-98f2-467333a2a011 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156927 Sep 13 14:32:12.680155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1576/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:12.784155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:12.784686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:12.786541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:12.791688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.792157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.792583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.793254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:12.793699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:12.794206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:12.924358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:12.932924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c60528a-a0a6-4e2e-8b26-dbb126fee5ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152682 Sep 13 14:32:12.933477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1488/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:12 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:13.193193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:13.193711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:13.200667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.201137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.201564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.202272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.202722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.203137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.329046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:13.337669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:13.339126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:13.340282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-92ba9f0b-ef37-48e8-8653-1fd8a42926ca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151068 Sep 13 14:32:13.340863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1577/3065] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:13.344354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:13.344963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:13.352230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.352714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.353153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.353882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.354339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.354762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.480302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:13.488394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7371eef0-e731-4c49-957f-6f247bc4679b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147915 Sep 13 14:32:13.488961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1489/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:13.702491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:13.702936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:13.708906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.709384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.709835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.711018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.711460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.711877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.845016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:13.853919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9467d7c4-b097-472c-8233-cc0ebb003250 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155410 Sep 13 14:32:13.854482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1578/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:13.956145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:13.956743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:13.963086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.963550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.963977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:13.964648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:13.965091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:13.965504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:14.098588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:14.106848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8e9f390-891b-43b3-9303-1ca3f68c3fb6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154477 Sep 13 14:32:14.107406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1490/3068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:13 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:14.366813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:14.367460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:14.373833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:14.374307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:14.374738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:14.375410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:14.375859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:14.376275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:14.502189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:14.511568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:14.512741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:14.513017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:14.513345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:14.514199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7dd39238-6915-4518-90c3-1b037bdc0c31 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151946 Sep 13 14:32:14.514780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1579/3069] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:14.519739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:14.520207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:14.520950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:14.521306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:14.522066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:14.522486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:14.651933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:14.660293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6354038a-ebfb-4df8-b0a1-a6265f2264fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151238 Sep 13 14:32:14.660859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1491/3070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:14.876551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:14.877163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:14.884101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:14.884101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:14.884762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:14.885516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:14.886006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:14.886437 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.018466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:15.027283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b745ec20-1f70-4ea7-9b5e-9e8a3d4d39ed tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154495 Sep 13 14:32:15.027853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1580/3071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:15.129881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:15.130520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:15.136680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:15.137168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:15.137582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.138289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:15.138736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:15.139153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.267356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:15.276287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-515d3de3-0f77-4dac-b320-714ac3cf2c56 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150300 Sep 13 14:32:15.276842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1492/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:15 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:15.538746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:15.539354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:15.545711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:15.546219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:15.546656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.547335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:15.547786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:15.548206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.674516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:15.683182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:15.684270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:15.684619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:15.684873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:15.685794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-db10ace8-d4b0-487e-9950-3693f8273046 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150932 Sep 13 14:32:15.686468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1581/3073] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:15.691325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:15.691797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:15.692229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.692906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:15.693383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:15.693837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:15.838607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:15.847489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d5f804d-a6aa-43ef-8a88-b5797c8a0eb1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.167329 Sep 13 14:32:15.848057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1493/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:16.051167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:16.051809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:16.058175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.058649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.059227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.059903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.060351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.060767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.190364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:16.199214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f27ad532-439a-4547-a6d4-412f4f0b6411 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152037 Sep 13 14:32:16.199796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1582/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:16.299257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:16.299890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:16.306600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.307025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.307460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.308145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.308632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.309058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.433941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:16.442012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6af983cd-24d8-4916-9e99-ba5852ffe0fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.146618 Sep 13 14:32:16.442569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1494/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:16 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:16.712158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:16.712760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:16.718792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.719278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.719715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.720400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.720856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.721280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.848117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:16.856883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:16.858377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:16.860408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e370fe09-44e7-4ee9-8902-35ca3afc5eb0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152767 Sep 13 14:32:16.860969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1583/3077] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:16.871845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:16.881485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:16.881485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.881485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.881485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:16.883462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:16.883462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:16.883462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:17.012756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:17.020964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f61b3ad8-df84-42ef-b87e-a35041ed6df1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152858 Sep 13 14:32:17.021515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1495/3078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:17.222629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:17.223243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:17.230092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:17.230568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:17.230998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:17.231677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:17.232127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:17.232549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:17.360360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:17.369042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-556cb6fe-b283-4f18-824d-49180d55c0fb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150216 Sep 13 14:32:17.369608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1584/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:17.465156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:17.465945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:17.471785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:17.472265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:17.472742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:17.473376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:17.473856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:17.474283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:17.604281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:17.612599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5595ebb1-784c-4a99-a9f6-ae0d2a22c5fa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151468 Sep 13 14:32:17.613209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1496/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:17 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:17.886985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:17.887565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:17.893549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:17.894059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:17.894485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:17.895159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:17.895603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:17.896017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.044918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:18.045528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:18.052120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:18.052598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:18.053119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.054581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:18.054889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:18.055309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.187762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:18.196415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d295567f-3edf-4830-9c90-fd5850203881 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155351 Sep 13 14:32:18.196994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1497/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:18.271169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:18.280398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:18.281876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:18.283020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3a7bbca4-c669-4e72-b1e6-43f9349f6e11 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.400060 Sep 13 14:32:18.283569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1585/3082] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:18.393515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:18.394173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:18.402217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:18.402773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:18.403245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.404046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:18.404594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:18.405073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.545559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:18.553805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f131301b-b0c5-4f07-82af-e3c30656345c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.164875 Sep 13 14:32:18.554465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1498/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:18.636581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:18.637191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:18.643124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:18.643663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:18.644052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.644738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:18.645226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:18.645652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:18.770531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:18.779565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5edab50-2e7b-4549-adf6-b0916c2617a4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147443 Sep 13 14:32:18.780123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1586/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:18 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:19.220063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:19.220613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:19.227107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.227576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.228002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.228680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.229123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.229535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.309517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:19.310149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:19.316621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.317099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.317533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.318256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.318708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.319138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.357459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:19.366017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-37e97e94-6c6b-4669-a5ba-5cb29593b221 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149802 Sep 13 14:32:19.367289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1499/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:19.458942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:19.467739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:19.469187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:19.470430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-79d7c0ae-459e-4e51-ab87-2ed5933a796a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.164784 Sep 13 14:32:19.470926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1587/3086] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:19.576274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:19.576926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:19.582910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.583380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.583808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.584488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.584977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.585411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.713935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:19.722402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46e928d4-9e6f-4572-8269-0135a4f88573 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149906 Sep 13 14:32:19.722905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1500/3087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:19.802598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:19.803206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:19.809798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.810281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.810712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.811390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:19.811850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:19.812273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:19.938610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:19.947434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fe24d1c2-ef77-4987-a966-3a27fe01b5a3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148628 Sep 13 14:32:19.947990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1588/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:20.390213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:20.390745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:20.397881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.398359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.398792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.399473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.399921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.400340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.496283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:20.496889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:20.503441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.503928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.504364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.505063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.505827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.506497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.535268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:20.544253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dab2cc08-a5ae-45d7-8c9f-7f9ca11bca4c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157906 Sep 13 14:32:20.544818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1501/3089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:20.637006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:20.645548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:20.647218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:20.648885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82c1d813-374b-4e37-b2e9-9bc95bca0457 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156545 Sep 13 14:32:20.649439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1589/3090] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:20.746191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:20.746829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:20.752686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.753169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.753599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.754310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.754760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.755178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.886002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:20.894232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef6b87ad-6858-4e65-9851-49c081c3034b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151920 Sep 13 14:32:20.894791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1502/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:20.970576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:20.971307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:20.977286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.977796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.978234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:20.978922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:20.979376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:20.979799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.113069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:21.122054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-86adb734-f93b-480a-93af-803475666bac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155212 Sep 13 14:32:21.138074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1590/3092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:20 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:21.566738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:21.567337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:21.574395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:21.574865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:21.575293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.575965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:21.576413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:21.576827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.674565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:21.675815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:21.682156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:21.682631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:21.683058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.683737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:21.684188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:21.684607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.703329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:21.704669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:21.711881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f5e21e92-96a1-4133-8997-b2661e9105da tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148997 Sep 13 14:32:21.712453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1503/3093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:21 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:21.812608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:21.821610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:21.823059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:21.824193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-326ebca8-5623-4989-b109-b373c97eedd4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153497 Sep 13 14:32:21.824739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1591/3094] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:21.917756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:21.918351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:21.924200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:21.924671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:21.925097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.925798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:21.926243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:21.926662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:21.931138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:22.051565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:22.060204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea8afdcc-d1e2-4079-865d-09548e0bc872 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.146283 Sep 13 14:32:22.060828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1504/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:22.145896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:22.146511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:22.153038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:22.153522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:22.154006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:22.154693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:22.155169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:22.155610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:22.173660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:32:22.173866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:32:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 (ip 10.222.0.20) !!! Sep 13 14:32:22.294477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:22.302582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cb77cece-cb28-4cd4-93f1-349b2a2c0751 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160497 Sep 13 14:32:22.303152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1592/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:22 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:22.735839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:22.736463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:22.743613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:22.744086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:22.744521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:22.745211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:22.745665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:22.746115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:22.849845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:22.850614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:22.857258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:22.857769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:22.858210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:22.859146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:22.859373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:22.859797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:22.879757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:22.888647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-567a11df-6e30-4adb-8740-856e679743ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156608 Sep 13 14:32:22.889222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1505/3097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:22.988257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:22.997373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:22.998863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:22.999995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e86107b7-92d2-4c84-8197-4f13c12ece3f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154110 Sep 13 14:32:23.000544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1593/3098] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:23.084346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:23.084973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:23.090914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:23.091400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:23.091839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:23.092519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:23.092977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:23.093401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:23.219815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:23.228866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d7776a0-08cf-4cc9-bde3-d78cc11c170b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148429 Sep 13 14:32:23.229432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1506/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:23.326281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:23.326884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:23.332691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:23.333178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:23.333606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:23.334303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:23.334802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:23.335192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:23.464018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:23.472102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e7435b5-9c05-4b49-abc4-b6dec75ea2bb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149550 Sep 13 14:32:23.472655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1594/3100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:23 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:23.912405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:23.913535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:23.919561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:23.920034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:23.920463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:23.921145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:23.921596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:23.922048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.026555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:24.027148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:24.033791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:24.034266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:24.034693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.035376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:24.035831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:24.036249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.051033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:24.060121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b7f1d88-2923-4dbd-aa30-4a4697a4c253 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151602 Sep 13 14:32:24.060788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1507/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:24.171294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:24.180068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:24.181504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:24.182695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-363a0c99-45d0-4610-aacb-bfa176c98141 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160200 Sep 13 14:32:24.183245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1595/3102] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:24.250968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:24.251577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:24.258265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:24.258741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:24.259171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.259860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:24.260307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:24.260727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.405202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:24.413457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e04fc14-ad1a-4e88-a3cb-99c5a7f72126 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.166282 Sep 13 14:32:24.414042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1508/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:24.496125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:24.496784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:24.502759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:24.503235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:24.503667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.504345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:24.504796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:24.505216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:24.634654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:24.642798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7cf617c9-2a04-4df7-a0ed-b83e5f288aeb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150488 Sep 13 14:32:24.643358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1596/3104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:24 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:25.082688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:25.083484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:25.089598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.090102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.090530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.091204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.091652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.092067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.209428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:25.210305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:25.217246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.217747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.218319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.219071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.219529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.219951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.220737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:25.230513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eb87dde7-1432-446d-a7fc-42b3e98efaf6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151707 Sep 13 14:32:25.231092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1509/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:25.352338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:25.361388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:25.362635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:25.363796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0a64971-1045-4f27-ad1f-15e7d895a0d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159585 Sep 13 14:32:25.364351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1597/3106] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:25.437241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:25.437875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:25.443903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.444381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.444811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.445485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.445964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.446384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.575085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:25.583319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93f00e4f-265b-497a-bd7d-64e285ab0cee tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150019 Sep 13 14:32:25.583888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1510/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:25.667127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:25.667879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:25.674078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.674508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.674945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.675665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:25.676153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:25.676624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:25.801956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:25.810555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a2c679cf-0607-41fc-86ff-8ef6dfb86741 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148159 Sep 13 14:32:25.811117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1598/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:25 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:26.253616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:26.254263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:26.260916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.261391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.261851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.262532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.262981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.263402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.389806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:26.390419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:26.390595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:26.397123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.397616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.398089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.398781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.399191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-570c4bc3-eb22-4763-afae-3bdfe9e7c3a6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149389 Sep 13 14:32:26.399321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.399768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.399910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1511/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:26.540014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:26.548764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:26.550253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:26.551412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4434e341-19b7-4410-a22f-e16c21f930e1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.165572 Sep 13 14:32:26.551967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1599/3110] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:26.606934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:26.607543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:26.614066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.614547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.614982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.615669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.616718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.617377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.743930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:26.752017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fed352c8-cc01-48b9-9446-4ee62025f064 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149053 Sep 13 14:32:26.752583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1512/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:26.834193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:26.834747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:26.841236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.841719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.842190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.842879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:26.843337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:26.843767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:26.972398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:26.981170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dec07e34-1ca3-4d70-85e8-a4c864638665 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150907 Sep 13 14:32:26.981751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1600/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:26 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:27.422365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:27.422964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:27.428858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:27.429329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:27.429783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:27.430457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:27.430901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:27.431310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:27.564119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:27.573610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-268aa211-0396-4cd9-8ca3-1f7e0598fce6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155080 Sep 13 14:32:27.574439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1513/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:27 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:27.578247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:27.578855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:27.585651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:27.586163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:27.586615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:27.587272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:27.587719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:27.588267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:27.716626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:27.725091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:27.726871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:27.728015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb45f719-9d2b-4c46-89c5-8363a731163c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153959 Sep 13 14:32:27.728564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1601/3114] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:27.776448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:27.777055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:27.783119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:27.783594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:27.784035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:27.784714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:27.785163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:27.785583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:27.911977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:27.920282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57e6fe27-748b-42be-9858-acbdb171f9b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148548 Sep 13 14:32:27.920847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1514/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:28.004234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:28.004762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:28.011350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.011827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.012254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.012938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.013385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.013828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.141589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:28.150222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6242ef3-bbb3-42a1-964a-9f2cf195d6cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149822 Sep 13 14:32:28.150786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1602/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:27 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:28.596879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:28.597483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:28.604118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.604588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.605019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.605695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.606162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.606577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.738464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:28.747018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-95c3cefb-116f-4491-b6cd-ef6171d9c86a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153957 Sep 13 14:32:28.747656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1515/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:28.752409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:28.753011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:28.760320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.760804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.761243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.761959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.762426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.762856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.888717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:28.898246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:28.899777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:28.900933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88b91430-9e17-438b-8ea1-4e743aed446c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152430 Sep 13 14:32:28.901491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1603/3118] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:28.943868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:28.944596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:28.950898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.951364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.951798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:28.952473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:28.952911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:28.953327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:29.079742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:29.088441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7d9b416-e379-4ac1-a906-6739feb626fa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148387 Sep 13 14:32:29.089001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1516/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:29.173084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:29.173613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:29.179788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:29.180253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:29.180690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:29.181371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:29.181859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:29.182285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:29.312538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:29.321148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ac8721cc-c635-42b4-982b-138c9cab6968 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151965 Sep 13 14:32:29.321709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1604/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:29 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:29.772627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:29.773240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:29.779196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:29.779617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:29.780048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:29.780731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:29.781177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:29.781596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:29.915674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:29.924124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98134455-e5de-45b0-bede-cc9b1f9c8918 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155513 Sep 13 14:32:29.924685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1517/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:29.926047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:29.926658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:29.933824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:29.934310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:29.934775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:29.935464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:29.935920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:29.936346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:30.063075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:30.071874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:30.073309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:30.074561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6de88e1d-03d7-43e1-a43a-5e0e54c665d1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152485 Sep 13 14:32:30.075113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1605/3122] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:30.110182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:30.110794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:30.117584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:30.118091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:30.118523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:30.119205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:30.119654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:30.120074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:30.244256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:30.252331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-caeec0f9-4882-4171-a532-df02add857d1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.145937 Sep 13 14:32:30.252892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1518/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:30.344431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:30.344971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:30.351665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:30.352168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:30.352585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:30.353274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:30.353748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:30.354176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:30.485257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:30.493609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cdab62b6-7edb-4976-b431-e932c1ddde23 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153124 Sep 13 14:32:30.494211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1606/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:30 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:30.948510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:30.949113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:30.955101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:30.955573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:30.956006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:30.956673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:30.957116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:30.957533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.088297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:31.096641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-39b4595b-7698-494f-9142-c3a789a76b0f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152698 Sep 13 14:32:31.097207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1519/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:31.099279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:31.099925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:31.106837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:31.107313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:31.107745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.108435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:31.108889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:31.109313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.238682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:31.247732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:31.249167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:31.250357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42c2a768-b599-413c-a7f4-d7e8b765da00 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155023 Sep 13 14:32:31.250914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1607/3126] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:31.275774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:31.276380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:31.282725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:31.283200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:31.283630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.284312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:31.284759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:31.285178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.411349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:31.415435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:31.420951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8316ab8-f8a5-43bc-ba23-8702bf376bd8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149281 Sep 13 14:32:31.421520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1520/3127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:31.518792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:31.519415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:31.525617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:31.526139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:31.526573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.527262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:31.527779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:31.528115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:31.532256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:31.658000 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:31.666649 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-16d32b26-b2ce-49fb-8a62-19cfc3226f82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151886 Sep 13 14:32:31.667211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1608/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:31 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:32.120308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:32.120833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:32.126799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.127278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.127706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.128386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.128836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.129260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.255319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:32.263936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48ad8e43-b6a2-427a-8e3c-3878d5f43b48 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148090 Sep 13 14:32:32.264496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1521/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:32.276728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:32.277327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:32.283683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.284143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.284577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.285254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.285704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.286150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.415820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:32.424297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:32.425746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:32.426884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-52de232f-ecdd-4d14-94a4-b75b1f56dbd0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155063 Sep 13 14:32:32.427451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1609/3130] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:32.445220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:32.445947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:32.452342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.452823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.453306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.454089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.454593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.455075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.588864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:32.597024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c935a278-688b-4d9d-bb16-e046e1b8482d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156554 Sep 13 14:32:32.597592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1522/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:32.689658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:32.690214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:32.696717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.697191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.697618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.698383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:32.698835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:32.699253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:32.829293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:32.838364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1aca0d7b-d436-4ce0-8181-536c924b337e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152526 Sep 13 14:32:32.838913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1610/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:32 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:33.288380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:33.288984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:33.294851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.295334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.295741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.296411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.296859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.297290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.422818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:33.430992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de6f4704-fed3-47a0-8ac4-f0457db49b4d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147030 Sep 13 14:32:33.431552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1523/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:33.453007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:33.453616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:33.460729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.461207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.461640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.462353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.462809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.463234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.598006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:33.606692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:33.608179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:33.609334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-63b0ecbb-cc35-40a3-9448-576cc6c8f4db tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160156 Sep 13 14:32:33.609919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1611/3134] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:33.619543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:33.620175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:33.627161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.627630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.628060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.628735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.629182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.629595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.757885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:33.766144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12cc3624-d2ca-4824-8c7c-294538bc9703 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150543 Sep 13 14:32:33.766719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1524/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:33.862679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:33.863284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:33.869460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.869975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.870407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:33.871355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:33.871537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:33.871959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:34.001373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:34.010197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-875c3f49-2e55-4afd-aa2b-dea5770cc9a0 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151225 Sep 13 14:32:34.010742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1612/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:33 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:34.460595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:34.461206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:34.467164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:34.467645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:34.474274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:34.474274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:34.474274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:34.474274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:34.635577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:34.636420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:34.636689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:34.643596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:34.644226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:34.644767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:34.645327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-222fc1b2-786f-480a-8aa3-5af61e6ce55e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.188838 Sep 13 14:32:34.645945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1525/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:34 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:34.646135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:34.646883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:34.648157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:34.780594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:34.789635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:34.790383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:34.791953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:34.793496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:34.794745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-01c68998-8132-4191-a2d9-d24807abfba1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.163817 Sep 13 14:32:34.795507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1613/3138] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:34.797274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:34.797869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:34.798367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:34.799052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:34.799505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:34.799916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.007454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:35.015790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78a2617b-6312-4290-8914-4103fd3c74b0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.230201 Sep 13 14:32:35.016378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1526/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:35.034384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:35.035034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:35.041537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:35.042316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:35.042786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.044046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:35.044046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:35.044440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.176665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:35.184894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-64a7df44-0046-427f-8941-2971014abdff tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156075 Sep 13 14:32:35.185466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1614/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:35 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:35.819711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:35.820375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:35.826728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:35.827274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:35.827774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.828451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:35.828903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:35.829322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.885313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:35.885952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:35.891927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:35.892409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:35.892839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.893529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:35.894009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:35.894496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:35.963155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:35.972909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:35.974495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:35.976999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e89a9000-5dcd-4f52-920c-96bda0d2cd43 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161294 Sep 13 14:32:35.977764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1615/3141] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:36.029616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:36.038601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-748ecca4-543a-4c56-bf97-e47998cd2722 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.372217 Sep 13 14:32:36.039168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1527/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:36.040191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:36.040891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:36.046704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:36.047181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:36.047609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:36.048302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:36.048733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:36.049154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:36.182262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:36.190389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0a9e3561-f53b-48d2-8b63-e540ffbbb138 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154539 Sep 13 14:32:36.190946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1616/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:36.208358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:36.208964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:36.214967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:36.215452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:36.215883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:36.216562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:36.217011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:36.217431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:36.345405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:36.353909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d265ab1e-cbcf-468a-8030-3421d2116cd1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149428 Sep 13 14:32:36.354506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1528/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:36 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:37.002717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:37.003331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:37.010435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.010915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.011350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.012031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.012486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.012909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.076982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:37.076982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:37.081703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.082213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.082649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.083337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.083974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.085172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.150609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:37.159159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:37.160622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:37.161815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-023a2567-bfb4-4acd-afe8-c3e97e1b3a81 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162993 Sep 13 14:32:37.163210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1617/3145] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:32:37.215041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:37.215694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:37.219620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:37.222664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.223144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.223575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.224265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.224712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.225209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.229540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-db2d6a7b-f0a6-448f-94ef-68139eed3ea6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158779 Sep 13 14:32:37.230258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1529/3146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:37.359004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:37.367851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-99cc886f-1138-4d0c-b393-7988bf295f5b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156755 Sep 13 14:32:37.368412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1618/3147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:37.376734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:37.377399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:37.383510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.383976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.384408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.385091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:37.385539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:37.385983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:37.511847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:37.519954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d4b825d4-f9cc-4af5-b633-43812feb7ebe tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147056 Sep 13 14:32:37.520516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1530/3148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:37 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:38.187378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:38.187981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:38.190347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:38.196473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.196952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.197386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.198090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.198538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.198955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.254038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:38.254638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:38.261609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.262135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.262559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.263236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.263677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.264090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.329861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:38.339643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:38.341043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:38.342257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f00f0924-ada5-4bc9-8c12-32313c8b996f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158730 Sep 13 14:32:38.342820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1619/3149] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:38.391131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:38.391743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:38.398631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.399115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.399549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.400273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.400725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.401146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.535413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:38.544156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e228b8d-bda1-4226-b68b-990cd494a7cf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156841 Sep 13 14:32:38.544729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1620/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:38.549159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:38.549772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:38.556472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.556954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.557386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.558101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:38.558557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:38.558980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:38.645396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:38.654184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e10cbed0-32d3-47e7-b2d0-88598e863ce9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.403864 Sep 13 14:32:38.654770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1531/3151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:38.697707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:38.705898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa434514-5cd7-487f-a2bb-3a71c41d84ec tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160197 Sep 13 14:32:38.706455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1621/3152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:38 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:39.367747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:39.368348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:39.374689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.375165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.375597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.376274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.376723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.377142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.510689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:39.519098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:39.520528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:39.522186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bd7ccbf0-2b1c-4a63-8eb0-e5d095e29896 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157999 Sep 13 14:32:39.522757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1532/3153] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:39.567866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:39.568538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:39.575578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.576055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.576481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.577159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.577602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.578043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.678862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:39.679649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:39.685655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.686161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.686594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.687272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.687719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.688136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.705563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:39.714418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-66f236de-a70d-444d-9629-14f27b383aa5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150375 Sep 13 14:32:39.714912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1622/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:39.728628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:39.729318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:39.735382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.735880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.736322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.737036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:39.737499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:39.737965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:39.829805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:39.838756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4f35c8fa-bb8e-49e0-bbe2-6ed30a7d1485 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163874 Sep 13 14:32:39.839342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1533/3155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:39.870697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:39.878816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-62932cae-7082-4279-999c-c231111940cc tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154101 Sep 13 14:32:39.879384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1623/3156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:39 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:40.547107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:40.547706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:40.554794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.555261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.555685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.556360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.556805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.557219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.683012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:40.696196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:40.697622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:40.698806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ed444c41-bcbb-4197-aaf7-9adc491661cd tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155537 Sep 13 14:32:40.699369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1534/3157] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:40.737827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:40.738462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:40.744787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.745259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.745685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.746387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.746833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.747251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.862163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:40.862769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:40.868591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.869062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.869486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.870207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.870654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.871069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.872900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:40.876307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:40.882040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5a61dc9-a078-46a4-9a09-5373fce422d3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147886 Sep 13 14:32:40.882625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1624/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:40.903381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:40.903992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:40.910330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.910813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.911247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:40.911933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:40.912401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:40.913481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:41.008015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:41.016394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcbf6d97-cc75-4d5a-a09f-336390fafdac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158237 Sep 13 14:32:41.016976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1535/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:41.041827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:41.051854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4a075bba-d26a-404c-93e8-27d54f3353c4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150466 Sep 13 14:32:41.052422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1625/3160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:40 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:41.725318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:41.725945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:41.732379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:41.732851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:41.733279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:41.733989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:41.734435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:41.734850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:41.870720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:41.879263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:41.880718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:41.882143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-865ec28d-1ef7-4a87-b2eb-e4fed001f033 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160800 Sep 13 14:32:41.882703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1536/3161] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:41.906243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:41.906879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:41.914021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:41.914503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:41.914960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:41.915628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:41.916080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:41.916502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:42.041107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:42.041714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:42.047619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:42.047822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:42.048088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:42.048513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:42.049196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:42.049640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:42.050282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:42.056625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7a1d200-cb07-45e0-9c71-ab1aa6d5b3ca tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154190 Sep 13 14:32:42.057199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1626/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:42.069157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:42.074993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:42.075549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:42.081375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:42.081900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:42.082347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:42.083042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:42.083504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:42.083928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:42.193828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:42.211499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-84b689b7-0341-4793-b89b-48c3663ed933 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.174779 Sep 13 14:32:42.212415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1537/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:42.214955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:42.223746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e37cfc67-54c0-4a51-8515-888a33b984e6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152529 Sep 13 14:32:42.224443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1627/3164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:42 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:42.907784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:42.908456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:42.910839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:42.916428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:42.916904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:42.917340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:42.918052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:42.918500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:42.918918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.048866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:43.058133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:43.059576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:43.060726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ffc11439-ae8c-4eea-91b8-0a2ae2e84eff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156809 Sep 13 14:32:43.061279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1538/3165] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:43.079594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:43.080217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:43.086682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:43.087160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:43.087595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.088276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:43.088729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:43.089150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.216843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:43.225118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b31ae6e3-5b15-49b5-a695-cf43e1dc9fe5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149215 Sep 13 14:32:43.225686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1628/3166] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:43.235302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:43.236057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:43.242405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:43.242883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:43.243316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.243999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:43.244451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:43.244873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.247847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:43.248256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:43.254167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:43.254653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:43.255089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.255789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:43.256915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:43.257688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:43.374476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:43.382892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e61b83a7-b9dd-42b7-8bdb-ce0817573d84 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151394 Sep 13 14:32:43.383478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1539/3167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:43.386750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:43.395348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d729652d-03ed-4f52-8f31-442d5b20c2d4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151574 Sep 13 14:32:43.396200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1629/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:44.087343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:44.087928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:44.094314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.094784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.095209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.095883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.096324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.096740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.227665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:44.236181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:44.237610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:44.238779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-131958a0-176d-4268-b7fc-8652f2466d6d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155349 Sep 13 14:32:44.239331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1540/3169] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:44.247748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:44.248356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:44.254734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.255210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.255639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.256313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.256761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.257336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.385867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:44.394109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-abe729fd-7dc9-4c1e-9803-51e0ceed5abc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150228 Sep 13 14:32:44.394700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1630/3170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:44.406357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:44.406994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:44.412938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.414064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.414560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.415278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.415729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.416151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.420213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:44.420936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:44.426787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.427272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.427709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.428402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:44.428861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:44.429601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:44.555049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:44.565066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3612a8b7-f8cc-4fa2-8748-a5b1f35c91fb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.162397 Sep 13 14:32:44.573921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:44.574402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1541/3171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:44.574531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-76570da4-97b6-4224-a24d-e6247ca41847 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.158093 Sep 13 14:32:44.575230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1631/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:44 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:45.264728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:45.265359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:45.271968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.272441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.272869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.273547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.274163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.274589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.399077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:45.407514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:45.408997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:45.410174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-633dadb5-e5f4-4d9d-aa61-bb9d69de5ac6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.149444 Sep 13 14:32:45.410724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1542/3173] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:45.417836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:45.418459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:45.424946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.425428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.425907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.426627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.427083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.427511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.555580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:45.563788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b634f52a-6e2a-4d7b-9a4e-075830bd96e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149895 Sep 13 14:32:45.564342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1632/3174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:45.588265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:45.588876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:45.594950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.595434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.595866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.596553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.597010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.597435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.597567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:45.598162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:45.604768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.605276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.605746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.606447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:45.606911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:45.607601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:45.741281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:45.750482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f908dfb0-2a96-4f48-b1ed-435cc6f74a65 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.166156 Sep 13 14:32:45.751078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1543/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:45.973623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:45.982460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-365f3233-c460-4914-9a9e-699ea33e07d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.388701 Sep 13 14:32:45.983021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1633/3176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:45 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:46.435280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:46.435885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:46.442607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:46.443085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:46.443521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:46.444205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:46.445319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:46.445912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:46.574627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:46.587521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:46.587684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:46.588253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:46.588972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:46.590172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-affe9326-7478-491f-81db-5d7bd1df9722 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158816 Sep 13 14:32:46.591045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1544/3177] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:46.596406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:46.596887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:46.597537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:46.598266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:46.599282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:46.599809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:46.729873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:46.738084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-689ce030-35e7-4f9c-b6c7-f7216f186c53 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155784 Sep 13 14:32:46.738641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1634/3178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:46.774485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:46.775125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:46.781031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:46.781506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:46.781985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:46.782675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:46.783124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:46.783543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:46.914325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:46.922396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-399842b9-a9a8-4e15-b5fb-6134200fb39a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152040 Sep 13 14:32:46.922968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1545/3179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:47.004566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:47.005178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:47.011640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.012123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.012553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.013228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.013679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.014121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.146206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:47.154731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-691a0ab1-f7be-409d-aa64-181f3fe8a6d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154132 Sep 13 14:32:47.155293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1635/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:46 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:47.615571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:47.616219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:47.622820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.623297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.623734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.624418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.624868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.625291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.752916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:47.762150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:47.762637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:47.762914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:47.763968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:47.765178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c7edc93-f3e5-4f29-9716-a3b8ca938f34 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153540 Sep 13 14:32:47.769230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.769828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.770320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.771083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.771604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.772340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.778092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1546/3181] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:47.898315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:47.906345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e9ed3788-ac3b-4a6b-9cd3-d03fdc1d64bf tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148118 Sep 13 14:32:47.906904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1636/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:47.945529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:47.946161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:47.952009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.952484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.952914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:47.953596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:47.954078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:47.954502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.083162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:48.091993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab11ae84-d11a-41a7-bd39-615e133cbfc6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150852 Sep 13 14:32:48.092560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1547/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:48.178157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:48.179294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:48.185535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:48.186040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:48.186470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.187146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:48.187595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:48.188014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.316419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:48.325157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8ef4c035-5b7a-410a-98b8-d93461599ac8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150808 Sep 13 14:32:48.325722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1637/3184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:48.792347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:48.792974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:48.799526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:48.799855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:48.800284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.800967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:48.801414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:48.801904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.929331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:48.930010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:48.930905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:48.936011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:48.936486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:48.936913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.937593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:48.938074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:48.938527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:48.939506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:48.940962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:48.942147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-264e10a2-77c0-4656-9c89-78d35b3eae66 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154593 Sep 13 14:32:48.942712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1548/3185] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:49.063745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:49.072041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3633510-b88b-45f7-9815-13049cd443a8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.146781 Sep 13 14:32:49.072608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1638/3186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:49.115367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:49.115970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:49.121968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:49.122444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:49.122869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:49.123540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:49.123984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:49.124398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:49.249575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:49.258588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7ca087ae-e01f-41ec-bc3f-fb04d13131c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147062 Sep 13 14:32:49.259150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1549/3187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:49.347962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:49.348494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:49.354914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:49.355391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:49.355820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:49.356495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:49.356942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:49.357364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:49.484536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:49.492928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8fc78ce8-cf60-434e-b711-b966c4f30e1a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148858 Sep 13 14:32:49.493493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1639/3188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:49 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:49.967000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:49.967600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:49.974097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:49.974575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:49.974999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:49.976300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:49.976839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:49.977261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.097026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:50.097765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:50.104249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:50.104737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:50.105175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.105934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:50.106392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:50.106815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.111367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:50.122475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:50.123910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:50.125049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91cfa3b3-3b78-45eb-9ef5-a9b1b2c38de3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161991 Sep 13 14:32:50.125602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1550/3189] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:50.235906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:50.244061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-de7c656a-6dfa-47ea-8a99-f5aa9888988b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150882 Sep 13 14:32:50.244621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1640/3190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:50.281205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:50.281837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:50.287628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:50.288246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:50.288683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.289358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:50.289829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:50.290247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.421719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:50.430404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b12516c7-badc-4da4-8c3a-897be0c040d5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152802 Sep 13 14:32:50.430969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1551/3191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:50.516550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:50.517282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:50.524927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:50.525419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:50.525922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.526688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:50.527184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:50.527662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:50.546406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:50.656852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:50.665538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-25f9d294-c7a2-4274-b40c-25f995951a04 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152981 Sep 13 14:32:50.666143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1641/3192] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:51.151446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:51.151978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:51.158333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.158801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.159226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.159900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.160344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.160768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.267395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:51.268101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:51.275030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.275589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.276090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.276848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.277398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.277924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.291918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:51.300498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:51.301961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:51.303107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-092a72f0-86a5-4e5c-b78e-d7cc79ab6093 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156377 Sep 13 14:32:51.303717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1552/3193] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:51.407323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:51.416045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9bd68836-08f3-4368-9a01-1b2a1472615b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152553 Sep 13 14:32:51.416611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1642/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:51.454242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:51.454846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:51.461587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.462094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.462532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.463220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.463670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.464091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.592773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:51.601061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e053f62-4aac-4398-a927-e58b6ab93d87 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150637 Sep 13 14:32:51.601628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1553/3195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:51.689049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:51.689589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:51.696917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.697391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.697843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.698522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:51.698973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:51.699390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:51.839348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:51.847456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-714534a5-539f-489b-83c7-8f8a29de83d1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162312 Sep 13 14:32:51.848012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1643/3196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:51 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:52.328749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:52.329282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:52.336350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.336825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.337263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.337996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.338448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.338870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.342928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:32:52.438967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:52.439697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:52.446525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.447092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.447607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.448375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.448912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.449343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.466686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:52.475278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:52.476724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:52.477898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-73f12df5-8fe7-4287-a885-49796ca28008 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153102 Sep 13 14:32:52.478456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1554/3197] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:52.576344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:52.584545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4b778970-f620-4f78-89f4-13e375b0b569 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149365 Sep 13 14:32:52.585853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1644/3198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:52.623903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:52.624517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:52.630479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.630961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.631398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.633045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.633509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.634001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.764244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:52.772616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a3ed60e1-1b5e-465c-9c51-5bf8a9897d30 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152509 Sep 13 14:32:52.773174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1555/3199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:52.871464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:52.872007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:52.878372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.878856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.879292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:52.879981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:52.880440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:52.880863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.014366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:53.023002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7c8b7435-08fd-44e9-b6ec-2a4807ad0d3b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155241 Sep 13 14:32:53.023724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1645/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:53.503684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:53.504310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:53.511126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:53.511599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:53.512031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.512711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:53.513189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:53.513604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.607711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:53.609143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:53.615254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:53.615885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:53.616982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.617929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:53.618381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:53.618799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.655231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:53.665600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:53.667077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:53.668689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-98ce179f-1d05-45fa-a4cb-526a49cf98b3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168675 Sep 13 14:32:53.670127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1556/3201] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:53.766386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:53.774854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37c472bf-fbed-40d6-8dcf-38c848656081 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.170950 Sep 13 14:32:53.775422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1646/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:53.796910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:53.797528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:53.804391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:53.805132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:53.805575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.806337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:53.806792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:53.807217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:53.947351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:53.955697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-222182e8-7dec-41c4-86d1-3d9772b3cef6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163347 Sep 13 14:32:53.956259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1557/3203] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:54.046328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:54.046934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:54.053173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.054468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.054956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.055637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.056090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.056512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.189272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:54.197574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9c0a3981-ac34-46e4-b2eb-7d8cc81dded3 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155070 Sep 13 14:32:54.198174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1647/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:54.694045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:54.695589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:54.702288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.702835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.703265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.704002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.704449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.704867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.799177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:54.799819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:54.806213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.806698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.807131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.807820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.808276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.808695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.842575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:54.851692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:54.853148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:54.854346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14d4b506-987e-4ed9-88f6-74ea9b7945ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.164231 Sep 13 14:32:54.854915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1558/3205] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:54 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:54.935271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:54.943677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e0fdcb9-7f3a-48ae-8600-27c741c8eaaa tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148309 Sep 13 14:32:54.944252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1648/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:54.979074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:54.979707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:54.985948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.986425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.986856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:54.987541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:54.987991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:54.988415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:55.124456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:55.132539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de5e332a-d82c-4ca9-b1d5-b5a9cdf221ef tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157445 Sep 13 14:32:55.133101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1559/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:55.221450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:55.222100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:55.229461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:55.230397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:55.230835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:55.231559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:55.232013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:55.232432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:55.364619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:55.373574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e4cdd2f-9419-425c-96fd-d0485088c111 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155934 Sep 13 14:32:55.374167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1649/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:55 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:55.880338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:55.880855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:55.887533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:55.888014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:55.888451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:55.889134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:55.889584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:55.890039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:55.969096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:55.969782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:55.975945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:55.976426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:55.976876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:55.977596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:55.978066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:55.978485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:56.018143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:56.028140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:56.029637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:56.030819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2e29c95f-acde-43cb-9d56-aeea51b6e477 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154440 Sep 13 14:32:56.031383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1560/3209] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:56.105412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:56.113641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42eeacc1-b21e-4db3-96f5-cbdfdb9ed93a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148628 Sep 13 14:32:56.114234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1650/3210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:55 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:56.156312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:56.156916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:56.163169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:56.163715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:56.164223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:56.164930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:56.165374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:56.165820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:56.294069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:56.302163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a3ea5e8-3a03-4163-811d-feb70bb6d6b9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149603 Sep 13 14:32:56.302721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1561/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:56.396388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:56.397221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:56.403665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:56.404146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:56.404580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:56.405262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:56.405716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:56.406162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:56.533963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:56.542407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eead9cab-e7a0-46b7-a3a4-7fb7792767b6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149959 Sep 13 14:32:56.542970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1651/3212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:57.056855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:57.057462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:57.064014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.064484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.064910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.065621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.066096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.066517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.136661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:57.137270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:57.143273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.143747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.144180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.144861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.145308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.145756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.217944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:57.226978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:57.229136 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:57.230344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1335e293-e7ef-4caf-bb9b-30bceac0afc4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.178257 Sep 13 14:32:57.230862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1562/3213] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:57.251749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:32:57.252030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:32:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed (ip 10.222.0.20) !!! Sep 13 14:32:57.295630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:57.303981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2e5463e-0c03-40f0-80a8-7f50d4147078 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.171347 Sep 13 14:32:57.304557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1652/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:57.325522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:57.326166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:57.332538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.333012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.333441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.334151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.334596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.335015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.469143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:57.478951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1350f2f1-7747-4cd6-b2d2-268504e9a13c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157180 Sep 13 14:32:57.479550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1563/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:57.566527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:57.567154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:57.574883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.575370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.575811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.576505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:57.576966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:57.577393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:57.705410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:57.714362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-60f42006-fe13-4147-b18d-3cf49bf004ad tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151893 Sep 13 14:32:57.714937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1653/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:57 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:58.255735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:58.256341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:58.262847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.263314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.263741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.264412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.264856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.265273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.327867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:58.329035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:58.335142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.335709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.336279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.337232 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.337777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.338392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.409850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:58.420507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:58.421976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:58.423127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2450e867-ffb0-4d9d-887a-208d5ada61ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.171457 Sep 13 14:32:58.423681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1564/3217] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:58.484357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:58.493090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-85629e77-5526-4cff-99c8-06e88273fc77 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.168433 Sep 13 14:32:58.493671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1654/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:58.502013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:58.502712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:58.509147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.509594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.510068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.510766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.511260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.511689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.637472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:58.645602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7e16a0f-33ca-444c-802a-567cb461e6b3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147461 Sep 13 14:32:58.646211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1565/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:58.737231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:58.737906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:58.744904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.745379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.745906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.746605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:58.747035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:58.747451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:58.876692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:58.885016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5fb2c31c-d0d8-4827-aaa6-8f86d791f0a8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151572 Sep 13 14:32:58.885574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1655/3220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:58 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:32:59.449753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:59.450373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:59.457610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.458137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.458576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.459267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.459938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.460367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.516336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:59.517692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:59.525364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.526174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.526775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.528455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.529087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.529507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.608363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:59.618384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:59.620374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:59.621875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ad47d1b-1517-4be4-a69e-0667457f824c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.177303 Sep 13 14:32:59.622574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1566/3221] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:32:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:32:59.666021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:59.670127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:59.670781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:59.674282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d307ac58-16ad-4448-b77a-9e2e13cfa851 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.162030 Sep 13 14:32:59.674851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1656/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:59.676668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.677146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.677584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.678321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.678776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.679199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.811011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:32:59.819088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71954c9f-a288-4469-99f4-5f554bcc1e8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152829 Sep 13 14:32:59.819650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1567/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:32:59.908710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:32:59.909245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:32:59.916047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.916518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.916948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:32:59.917626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:32:59.918104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:32:59.918519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.047932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:00.056485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7670cb68-5a9a-46c3-b1b1-1e17c095a19f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151701 Sep 13 14:33:00.057041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1657/3224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:32:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:00.648054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:00.648636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:00.655631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:00.656112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:00.656545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.657224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:00.657676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:00.658123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.698225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:00.698836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:00.705754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:00.706441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:00.707045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.707978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:00.708732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:00.709085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.714905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:00.790105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:00.799273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:00.800814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:00.802006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ea3435d-e601-4f6d-8a6c-a698d65f544e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158205 Sep 13 14:33:00.802565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1568/3225] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:00 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:00.842652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:00.843319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:00.843922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:00.849741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:00.850226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:00.850652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.850862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eea68bce-00d9-4f7f-9096-c6bb04e348af tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157520 Sep 13 14:33:00.851326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:00.851439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1658/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:00.851776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:00.852188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:00.982012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:00.990143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d129e6d0-38dc-476e-b3b5-41253f5e3c61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150723 Sep 13 14:33:00.990729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1569/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:01.078659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:01.079265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:01.085509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:01.086013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:01.086460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:01.087210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:01.087657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:01.088074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:01.220181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:01.228847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-184ec4a2-855a-4a2e-bee7-68460bb9dfae tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154123 Sep 13 14:33:01.229409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1659/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:01.828269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:01.828878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:01.835387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:01.835865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:01.836862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:01.837789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:01.838251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:01.838678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:01.873826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:01.874542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:01.880508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:01.880983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:01.881412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:01.882306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:01.882764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:01.883277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:01.970924 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:01.974342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:01.980962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:01.982456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:01.983620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-557739af-b6aa-4bb3-898a-512f9760aeca tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159303 Sep 13 14:33:01.984177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1570/3229] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:02.012672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:02.014387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:02.015033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:02.020807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4057e7c2-8657-40a1-9ddf-50958402fcea tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150811 Sep 13 14:33:02.020962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:02.021286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:02.021413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1660/3230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:02.021999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:02.022735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:02.023191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:02.023625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:02.152298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:02.160523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a1a4c90-ae15-4e78-ab6c-3131a3d82068 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150162 Sep 13 14:33:02.161084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1571/3231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:02.252342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:02.253060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:02.260301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:02.260777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:02.261207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:02.262035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:02.262486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:02.262909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:02.392948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:02.401421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a625a028-2eee-447e-a554-be1d078bd39a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152898 Sep 13 14:33:02.402013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1661/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:02 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:03.009074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:03.010232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:03.016691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.017172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.017610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.018326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.018782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.019204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.045112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:03.045721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:03.051581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.052065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.052498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.053181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.053632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.054078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.146989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:03.156638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:03.158039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:03.159212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5933ee85-daa1-46a5-b0d1-aa6dcb09870d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154703 Sep 13 14:33:03.159772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1572/3233] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:03.183544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:03.183809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:03.184419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:03.190275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.190748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.191175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.191851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.192124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32fe5869-317c-4270-8435-b80697ba8e52 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150839 Sep 13 14:33:03.192291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.192702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1662/3234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:03.192848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.320082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:03.328995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26bdcb60-e959-4fb4-8882-a5773e97a692 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149437 Sep 13 14:33:03.329560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1573/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:03.424301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:03.424842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:03.431822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.432350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.432787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.433480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:03.433966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:03.434389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:03.562621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:03.571045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dc9b455e-f301-4a06-a2df-06bcffb75c14 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150664 Sep 13 14:33:03.571618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1663/3236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:03 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:04.184181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:04.184779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:04.191288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.191761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.192190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.192866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.193311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.193749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.215449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:04.216055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:04.222020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.222495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.222921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.223595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.224042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.224456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.326414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:04.335007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:04.337171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:04.338320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a63e0547-5707-42db-8b90-5e68b716c039 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157987 Sep 13 14:33:04.338880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1574/3237] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:04.352240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:04.354079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:04.357179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:04.360174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.360663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.361098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.361824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.362289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.362709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.365710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d792fa86-ad9e-4176-80e9-8ea786e09880 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154727 Sep 13 14:33:04.366299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1664/3238] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:04.487023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:04.495306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b1715f4-1fda-4ad9-a418-be386ef91839 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.146989 Sep 13 14:33:04.495879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1575/3239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:04.593692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:04.594332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:04.600738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.601225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.601666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.602382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:04.602842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:04.603269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:04.735526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:04.744959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4162a766-216f-49a6-bab2-38abaf1ff468 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154611 Sep 13 14:33:04.745532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1665/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:04 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:05.363500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:05.364096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:05.370794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.371267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.371696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.372376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.372826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.373248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.389051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:05.389679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:05.395596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.396074 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.396507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.397449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.397932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.398352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.507026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:05.516683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:05.518828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:05.519984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dee7db7a-a796-46bc-b642-d8e844e60e6a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160451 Sep 13 14:33:05.520542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1576/3241] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:05.526346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:05.527220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:05.533451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.534196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.534845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.536344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.536795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.537214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.543764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:05.552010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-aa457a26-71d1-4253-8fe0-880123c88466 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.167447 Sep 13 14:33:05.552747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1666/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:05.662722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:05.671897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-378de5dc-1070-4aef-baa6-7645f9d5e0dd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150171 Sep 13 14:33:05.672459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1577/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:05.768247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:05.768879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:05.776532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.777024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.777460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.778326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:05.778813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:05.779258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:05.907514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:05.915696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3584794b-45d0-41a8-9343-7e5480d17e00 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151208 Sep 13 14:33:05.916254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1667/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:06.547149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:06.547756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:06.554346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.555528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.555978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.556675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.557124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.557541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.575235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:06.576466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:06.583411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.584240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.584879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.585794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.586463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.587097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.688937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:06.697818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:06.699280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:06.700430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ffced0f-92f6-49ec-a375-b46d285a4063 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157279 Sep 13 14:33:06.700984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1578/3245] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:06.715960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:06.718628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:06.719241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:06.724092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-50874187-28a5-4fc5-8bab-47384a7629ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152819 Sep 13 14:33:06.724733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1668/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:06.725287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.725791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.726227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.727822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.728304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.728728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.869324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:06.877516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-271cfc23-cc11-456b-97c8-732be5f6405c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.162757 Sep 13 14:33:06.878116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1579/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:06.938579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:06.939226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:06.941635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:06.947469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.947945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.948375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:06.949054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:06.949507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:06.949955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.079700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:07.088522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6360d8f7-3c27-4547-9985-bc59f054b034 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153774 Sep 13 14:33:07.089076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1669/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:06 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:07.725282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:07.725920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:07.732598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:07.733077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:07.733507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.734223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:07.734678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:07.735097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.748564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:07.749170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:07.755097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:07.755607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:07.756040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.756722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:07.757167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:07.757587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.867874 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:07.878453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:07.879920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:07.881291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dfd54803-8a61-41a1-b8fc-da5d75758789 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159926 Sep 13 14:33:07.881878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1580/3249] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:07 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:07.902809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:07.903792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:07.906499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:07.910138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:07.910626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:07.911063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.911761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:07.912222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:07.912642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:07.914641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f80e97d3-4ec6-4edc-a6a2-879911948fa6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.169907 Sep 13 14:33:07.915781 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1670/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:08.045971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:08.054155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-38077640-a4c1-4f5b-b463-9a99cfeb52b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156006 Sep 13 14:33:08.054665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1581/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:08.112248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:08.112898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:08.120016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:08.120502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:08.120940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:08.121629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:08.122115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:08.122546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:08.252841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:08.261196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6da6e171-ff18-4748-8251-186694cedc2e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152749 Sep 13 14:33:08.261780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1671/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:08 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:08.918819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:08.919505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:08.926258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:08.926766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:08.927201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:08.927898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:08.928348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:08.928771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:08.938388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:08.939073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:08.946173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:08.947262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:08.947835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:08.948618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:08.949159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:08.949651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:09.060517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:09.069451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:09.070937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:09.072868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d004171-84d8-43d0-aa85-4ac5c9ae96dc tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157987 Sep 13 14:33:09.073619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1582/3253] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:09.079283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:09.079463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:09.080051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:09.089631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f919fa28-9e20-4070-9740-fa2c5cd0bf4a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154935 Sep 13 14:33:09.089900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:09.090132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:09.090392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1672/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:09.098076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:09.098076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:09.098076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:09.098076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:09.221156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:09.229848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2864e931-4669-4da3-9f0f-a2e233980981 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154562 Sep 13 14:33:09.230418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1583/3255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:09.285068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:09.285609 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:09.292842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:09.293318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:09.293767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:09.294483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:09.294933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:09.295353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:09.424060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:09.432365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f1e0c87b-8fe9-401c-8f55-f36743d54fa1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151136 Sep 13 14:33:09.432965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1673/3256] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:09 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:10.098664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:10.099279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:10.105832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.106319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.106760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.107449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.109050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.109050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.113909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:10.114515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:10.121406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.121921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.122355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.123080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.124026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.124026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.238831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:10.248201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:10.249667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:10.250865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dd40b693-e529-4037-9662-1fab766cc57c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156097 Sep 13 14:33:10.251427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1584/3257] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:10.255799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:10.256406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:10.256996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:10.260875 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:10.262564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.263256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.263888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.264590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.265043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.265676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.267813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a15dc720-a699-4fcb-a3f4-eebb2d004a91 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157655 Sep 13 14:33:10.268384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1674/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:10.392005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:10.400553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad386cb2-074a-403e-95eb-a067f4259f7f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148182 Sep 13 14:33:10.401119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1585/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:10.455803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:10.456529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:10.463050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.463533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.463967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.464650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:10.465105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:10.465529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:10.597798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:10.606591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-96eb7be3-e456-492f-bd17-7404cc07588a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154692 Sep 13 14:33:10.607155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1675/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:10 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:11.279003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:11.279637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:11.286184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.286665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.287095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.287778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.288231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.288654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.291738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:11.292343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:11.298281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.298759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.299190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.299870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.300322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.300743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.425902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:11.434639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:11.436066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:11.437217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2707056-323f-4d53-b2e4-600e07194bbb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162896 Sep 13 14:33:11.437787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1586/3261] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:11.442081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:11.442685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:11.448510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.449019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.449450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.450155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.450689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.451087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.469941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:11.534151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:11.543125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0bea04b0-7ac2-465d-8390-991b8890757d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.255846 Sep 13 14:33:11.543686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1676/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:11.581172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:11.589841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9239b57-8c65-42d3-8638-6caa39bccd1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151089 Sep 13 14:33:11.590418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1587/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:11.629185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:11.629812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:11.635719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.636196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.636627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.637302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:11.637770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:11.638192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:11.763751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:11.772082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-954cf42a-1dda-40dc-8776-33c44c73479c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.146493 Sep 13 14:33:11.772642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1677/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:11 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:12.462483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:12.463073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:12.465411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:12.470989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.471468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.471904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.472589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.473045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.473466 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.566215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:12.566923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:12.574134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.574699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.575142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.575831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.576287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.576707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.608257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:12.617332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:12.619416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:12.620560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-68161007-4a91-4a10-beb0-f6da718960fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162052 Sep 13 14:33:12.621123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1588/3265] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:12.625624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:12.626248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:12.631959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.632431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.632854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.633528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.634005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.634417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.711908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:12.720739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d0da8d12-5003-4d97-b9a7-8c87f3e2f602 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158392 Sep 13 14:33:12.721243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1678/3266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:12.762052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:12.770275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-481c61fb-c921-4054-bfe9-50d380fdc347 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148221 Sep 13 14:33:12.770832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1589/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:12.796139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:12.796753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:12.802869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.803355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.803790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.804478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:12.804935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:12.805388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:12.939981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:12.948915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ff472cda-76d4-4cf5-a654-66aea32fb5b4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156645 Sep 13 14:33:12.949473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1679/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:12 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:13.645424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:13.646075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:13.652835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.653306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.653752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.654440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.654883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.655298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.744511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:13.745165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:13.751421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.751897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.752352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.753034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.753481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.753931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.781343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:13.790095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:13.791536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:13.792694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94ad7a58-4308-4ce7-924b-213330652399 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151160 Sep 13 14:33:13.793255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1590/3269] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:13.797585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:13.798226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:13.803986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.804463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.804893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.805584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.806589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.807172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.883669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:13.892753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7d8713b5-de8f-4a69-b5dd-eca0b2d3db0f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152487 Sep 13 14:33:13.893435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1680/3270] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:13.938552 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:13.946705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88f7820a-b52c-4d0b-8343-918773cf83d8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152491 Sep 13 14:33:13.947264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1591/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:13.971887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:13.972491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:13.979062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.979532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.979961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:13.980638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:13.981085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:13.981502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:14.110818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:14.119477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a69e81f8-06a3-4839-9403-630c785f00ac tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151448 Sep 13 14:33:14.120037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1681/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:13 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:14.818389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:14.818963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:14.826122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:14.826591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:14.827014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:14.827686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:14.828133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:14.828544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:14.916391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:14.917122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:14.923599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:14.924086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:14.924518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:14.925212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:14.925667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:14.926128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:14.957508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:14.968011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:14.969449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:14.970727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1062814b-50fb-4718-adfd-46e7f8a2980e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156297 Sep 13 14:33:14.971412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1592/3273] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:14 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:14.975831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:14.976433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:14.982508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:14.982983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:14.983413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:14.984100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:14.985102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:14.985102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:15.058782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:15.067029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5c165f64-133d-4e43-88af-4a22821bca51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154946 Sep 13 14:33:15.067599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1682/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:15.115744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:15.124572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a6beceb-71d2-40db-a80e-3dacbd3b7805 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152184 Sep 13 14:33:15.125141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1593/3275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:15.141097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:15.141706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:15.147834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:15.148312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:15.148745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:15.149564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:15.150057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:15.150484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:15.284686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:15.293861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5495bad7-c786-4426-b3e0-3e93a38a2cd9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156458 Sep 13 14:33:15.294382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1683/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:15 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:15.996380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:15.996983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:16.003557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.004029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.004456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.005155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.005602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.006058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.090548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:16.091152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:16.097552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.098077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.098522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.099228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.099812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.100251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.137556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:16.146428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:16.148146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:16.149415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bb9de5ff-1155-4d2d-9b93-af8891fb1670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157345 Sep 13 14:33:16.149985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1594/3277] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:16.154638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:16.155251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:16.161115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.161604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.162101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.162872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.163359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.163755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.233092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:16.241404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-35df3be6-f63e-4df2-928b-da4f8723f27b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154796 Sep 13 14:33:16.242010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1684/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:16.302539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:16.311441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b25a96a-ce6c-4f0f-ac8c-5324cce21d19 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.160489 Sep 13 14:33:16.312758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1595/3279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:16.317650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:16.319329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:16.325200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.325790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.326355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.327170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:16.327632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:16.328081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:16.456787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:16.464858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a2fec334-3c53-4447-b01f-21fb83e07031 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151063 Sep 13 14:33:16.465421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1685/3280] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:16 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:17.176527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:17.177109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:17.183609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.184084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.184516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.185203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.185652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.186102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.265187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:17.265793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:17.273815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.274305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.275280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.275976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.276426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.276845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.317343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:17.327056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:17.330414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:17.331596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6822f47f-0e3f-4498-807c-f23005e92a7b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159096 Sep 13 14:33:17.338834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1596/3281] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:17.338834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:17.339440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:17.345121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.345603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.346060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.346748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.347194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.348356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.420960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:17.429828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a9ddda05-2d24-40c1-8106-b6a332a55c82 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.168451 Sep 13 14:33:17.431481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1686/3282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:17.488582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:17.489190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:17.494707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:17.498112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.498611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.499041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.499908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:17.500539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:17.501249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:17.503903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c6f382f-588d-4f60-a9d1-39641d2df098 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.170197 Sep 13 14:33:17.504501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1597/3283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:17.637041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:17.645105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-de84b144-b58c-4381-a4d9-a5e424e1926b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.160487 Sep 13 14:33:17.645660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1687/3284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:17 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:18.359444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:18.360044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:18.366678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.367150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.367580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.368804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.369278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.369695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.453622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:18.454357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:18.462702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.463448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.463967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.465014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.465244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.465776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.505247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:18.514745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:18.516234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:18.517389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9268233c-c549-4d51-ae9e-8706697049e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162073 Sep 13 14:33:18.517981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1598/3285] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:18.536515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:18.537137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:18.543975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.544537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.545068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.545872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.546410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.547010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.601056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:18.610129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08d15f1e-82d9-4821-b3d0-12b587b26c67 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160361 Sep 13 14:33:18.610630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1688/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:18.668894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:18.669505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:18.673964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:18.675505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.675993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.676425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.677118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:18.677572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:18.678019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:18.683333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-596d2415-b93f-48de-a81d-2d157c50e25c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.159083 Sep 13 14:33:18.683913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1599/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:18.807678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:18.815740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e225bad6-8fbf-42ad-b544-c53fa634d0cd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151220 Sep 13 14:33:18.816293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1689/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:18 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:19.543717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:19.544435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:19.551271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.551821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.552327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.553088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.553616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.554165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.635546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:19.636197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:19.642579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.643056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.643494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.644177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.644628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.645050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.765100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:19.774104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:19.776163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:19.777242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-661f523a-d156-4bcc-ab78-c568485bb772 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.238425 Sep 13 14:33:19.777824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1600/3289] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:19.778511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:19.782975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:19.783576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:19.786937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-59c37c57-9109-45bc-941a-4d8f780896e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155238 Sep 13 14:33:19.787679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1690/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:19.789677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.790915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.791343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.792028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.792471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.792885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.839504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:19.840111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:19.846004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.846487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.846919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.847607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:19.848062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:19.848484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:19.866603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:19.921250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:19.929468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e91f5066-01e9-4cc2-96e2-3fd4540ce1db tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150691 Sep 13 14:33:19.930070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1601/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:19.979024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:19.987077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7e07a26a-3d87-4121-81de-8a8edc5c8160 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151525 Sep 13 14:33:19.987633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1691/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:20.804059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:20.804656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:20.810635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:20.811243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:20.812012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:20.812494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:20.812922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:20.813603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:20.814100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:20.814519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:20.817834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:20.818319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:20.818751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:20.819451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:20.819901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:20.820322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:20.944499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:20.949080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:20.955600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:20.957048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:20.957211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9201d6f0-4140-4137-8ac2-c45d29086ef5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150872 Sep 13 14:33:20.957755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1692/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:20.958234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b6f54b8b-8698-414c-932a-bb80ae88052b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158393 Sep 13 14:33:20.973756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1602/3294] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:20 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:20.973959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:20.973959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:20.973959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:20.973959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:20.974405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:20.974405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:20.974405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:20.974405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.011412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:21.012028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:21.018000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:21.018490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:21.018922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.019638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:21.020073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:21.020494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.103677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:21.111808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0107a0e0-c8b8-4854-9c2e-b8f6d0936e1a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153112 Sep 13 14:33:21.112367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1693/3295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:21.156294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:21.164289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0880ae18-f2ee-42b3-afea-f900ddc31cb8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157556 Sep 13 14:33:21.164848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1603/3296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:21 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:21.980884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:21.981491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:21.984158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:21.984763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:21.987993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:21.988462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:21.988885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.989561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:21.990037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:21.990450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.991176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:21.991678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:21.992104 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.992786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:21.993749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:21.994159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:21.998176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:22.121300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:22.121702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:22.129721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-70f213a2-dee2-484d-b6da-87acac3a1cf2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152651 Sep 13 14:33:22.130367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:22.130522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1694/3297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:22.132168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:22.133342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-29b506b1-4883-4017-bde6-99d2420cf7b8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153133 Sep 13 14:33:22.134054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1604/3298] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:22.135389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:22.135999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:22.142034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:22.142520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:22.142954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:22.143639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:22.144096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:22.144517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:22.186898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:22.187512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:22.193512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:22.194026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:22.194458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:22.195147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:22.195597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:22.196538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:22.277568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:22.285890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-84ec77af-64e1-46ad-8b3a-8b698f396e3d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154331 Sep 13 14:33:22.286454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1695/3299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:22.333388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:22.342217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-89fe170c-34af-4d2f-a1be-6d23a560c8aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159085 Sep 13 14:33:22.342911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1605/3300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:22 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:23.153916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:23.154533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:23.158659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:23.159311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:23.160964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.161448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.161916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.162611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.163067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.163490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.166258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.166729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.167153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.167875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.168272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.168688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.294221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:23.296529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:23.302799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-293716a8-bbed-45bb-a496-6e8bb8c90f00 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153445 Sep 13 14:33:23.303459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1696/3301] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:23.306032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:23.307481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:23.308696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:23.308833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1510f995-b88d-4de1-8947-4f2017ad3cba tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153813 Sep 13 14:33:23.309288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1606/3302] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:23.309545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:23.315626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.316212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.316760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.317543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.318126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.318651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.365024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:23.365762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:23.372412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.372915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.373381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.374087 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:23.374534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:23.374952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:23.452645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:23.460852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0fc6862f-44c1-4ecf-b96d-c82ceab7887c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156442 Sep 13 14:33:23.461428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1697/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:23.507652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:23.516524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f49321c4-3cd2-443e-82be-c42f4cd670f4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155269 Sep 13 14:33:23.517090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1607/3304] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:23 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:24.326659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:24.327269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:24.333698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.333907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:24.334317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.334452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:24.334635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.335326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.335784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.336214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.341122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.341592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.342045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.342737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.343185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.343607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.473481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:24.475586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:24.483088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:24.484098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a81ab35c-dbdd-4c5e-a18c-1693867597f8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.161285 Sep 13 14:33:24.484524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:24.484928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1698/3305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:24.485837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-99ea2bdb-ce61-458a-9a21-99e757e8e922 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155830 Sep 13 14:33:24.486503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1608/3306] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:24.489597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:24.490236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:24.496107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.496589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.497026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.497708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.498227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.498653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.539970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:24.540716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:24.546770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.547252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.547686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.548375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:24.548822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:24.549240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:24.627158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:24.637187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-27661c7f-df9d-46dc-867d-53b7c662589c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151240 Sep 13 14:33:24.637793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1699/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:24.679170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:24.687401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6bb2255a-ed77-40f6-af18-8fb572e55eb1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151290 Sep 13 14:33:24.687964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1609/3308] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:24 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:25.507587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:25.508194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:25.510675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:25.511289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:25.514994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.515481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.515911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.516599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.517048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.517469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.517739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.518217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.518662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.519354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.519808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.520232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.651946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:25.659048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:25.660373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32657e1f-4ed3-4120-9964-41f3d8014780 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156618 Sep 13 14:33:25.660984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1700/3309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:25.666286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:25.666892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:25.668346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:25.669917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:25.671073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1df38cef-5807-4f9e-b906-fb0279e4e6d8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.164657 Sep 13 14:33:25.671800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1610/3310] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:25.672618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.673106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.673545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.674270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.674729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.675156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.710575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:25.711177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:25.719765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.720250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.720684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.721386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:25.721872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:25.722298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:25.807328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:25.815919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b114d8f7-f997-4883-acb5-34fcb1d86cb4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153958 Sep 13 14:33:25.819020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1701/3311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:25.857569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:25.866594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b34276c-950a-4142-b040-176b933f2e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159684 Sep 13 14:33:25.869227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1611/3312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:25 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:26.684996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:26.685605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:26.692005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.692491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.692928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.693650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.694128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.694552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.697055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:26.697659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:26.703438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.703909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.704337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.705042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.705487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.705936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.827683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:26.836772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-51a60e41-0608-4116-bfaa-340e2062cb92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156131 Sep 13 14:33:26.837259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:26.837637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1702/3313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:26.842982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:26.843578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:26.847292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:26.848885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:26.849279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.849931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.850092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbfc20fc-b10a-4662-b49c-aaa0af7511e8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158117 Sep 13 14:33:26.850365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.853532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1612/3314] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:26 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:26.853682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.853682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.853682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.890762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:26.891369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:26.897745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.898245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.898676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.900156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:26.900839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:26.901437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:26.991709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:27.000234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1036b57c-9635-4f06-8186-f52fefd22755 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.161601 Sep 13 14:33:27.000931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1703/3315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:27.040987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:27.049095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-93d5b341-8603-4447-8469-ab30e82b6f64 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162090 Sep 13 14:33:27.049661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1613/3316] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:26 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:27.861412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:27.861982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:27.869062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:27.869541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:27.870070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:27.870794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:27.871249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:27.871674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:27.875672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:27.876276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:27.882897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:27.883369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:27.884382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:27.885274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:27.885721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:27.886162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:28.003338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:28.012811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9b551cf0-4935-42a3-a5e1-f9e10158fcbc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155255 Sep 13 14:33:28.013484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1704/3317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:28.025025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:28.025708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:28.031757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:28.032009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:28.032387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:28.032886 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:28.033586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:28.034249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:28.034673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:28.041514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:28.043027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:28.044201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f4c6b22-0a32-4a86-a3ac-be47246eb94a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.172411 Sep 13 14:33:28.045023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1614/3318] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:28.072784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:28.073498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:28.079571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:28.080051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:28.080480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:28.081170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:28.081615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:28.082059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:28.170837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:28.179220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fa603e08-9e10-4d90-8c51-43ff8b216cf0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158400 Sep 13 14:33:28.179786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1705/3319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:28.224817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:28.233060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-72b16e27-55bb-4b9b-a390-3f4eb583ab94 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.164675 Sep 13 14:33:28.233613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1615/3320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:28 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:29.036075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:29.036689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:29.043742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.044219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.044651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.045336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.045820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.046245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.071364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:29.072059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:29.079027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.079502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.080118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.080805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.081252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.081667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.181564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:29.190037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c39e4bc2-08eb-45cd-bd34-d84494f39256 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157763 Sep 13 14:33:29.190608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1706/3321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:29.201404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:29.202241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:29.208050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.208530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.208958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.209639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.210114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.210538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.212514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:29.221124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:29.222587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:29.223733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8612d2af-2b0a-4b19-bee9-18f66c1c391b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157741 Sep 13 14:33:29.224285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1616/3322] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:29.255771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:29.256387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:29.262554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.263033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.263462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.264143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:29.264591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:29.265007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:29.345120 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:29.354239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e43c844-c531-4d8d-b3c3-d21d97e03e22 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156523 Sep 13 14:33:29.354995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1707/3323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:29.395820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:29.404849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-486ac4cd-f15c-4afc-a265-ff6f67463011 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152924 Sep 13 14:33:29.405418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1617/3324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:29 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:30.214284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:30.214932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:30.221323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.221845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.222291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.222977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.223436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.223865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.228661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:30.249892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:30.250495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:30.256858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.257344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.257786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.258603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.259085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.259710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.354854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:30.363060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-70841f17-ceba-4677-91d5-c21341ca291d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153492 Sep 13 14:33:30.363629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1708/3325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:30.377500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:30.378151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:30.383930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.384667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.384828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.385519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.386008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.386427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.392101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:30.401659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:30.403121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:30.404265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-54a6e2ff-3765-4805-8f77-e2667dc2f9c1 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158272 Sep 13 14:33:30.404813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1618/3326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:30.428168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:30.428793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:30.434887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.435442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.435940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.436715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:30.437233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:30.437720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:30.527787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:30.537237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6841935a-cf88-4647-b773-b13602141192 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163486 Sep 13 14:33:30.537848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1709/3327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:30.576006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:30.584206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05d87deb-e72e-4dc6-a9ed-e65f6bbd6496 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.159842 Sep 13 14:33:30.584786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1619/3328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:30 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:31.387262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:31.387874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:31.394243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.394721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.395181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.395893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.396357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.397024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.429488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:31.430043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:31.436488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.436957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.437383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.438096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.438551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.438971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.532444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:31.540762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8cd13e98-278a-4b48-8ecb-c5057b3ba8a4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157741 Sep 13 14:33:31.541336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1710/3329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:31.560409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:31.561179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:31.566988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.567475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.567906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.568595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.569051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.569470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.570400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:31.574405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:31.580639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:31.582115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:31.583266 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-314b32d6-aed4-4113-86a2-edc90129e3ed tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157731 Sep 13 14:33:31.583825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1620/3330] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:31.608125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:31.608761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:31.614917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.615395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.615833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.616522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:31.616974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:31.617393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:31.700236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:31.708426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e2a3f3d5-3de5-4339-b905-5796f200ba79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152255 Sep 13 14:33:31.708996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1711/3331] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:31.745304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:31.753559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f1d0bc7-e645-4448-a9f5-493aa81f3fc4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149103 Sep 13 14:33:31.754146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1621/3332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:31 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:32.564292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:32.564901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:32.572070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.572545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.572981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.573663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.574143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.574566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.609236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:32.609963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:32.616763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.617243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.617743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.618488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.618937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.619356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.706424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:32.715629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d392362-e1ff-40ee-9388-1ef23e63ecb6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155142 Sep 13 14:33:32.716205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1712/3333] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:32.731926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:32.732566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:32.738273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.738755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.739184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.739864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.740312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.740731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.752677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:32.762151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:32.763602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:32.764774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14d14250-df68-4282-b9e3-1ee13c286493 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159385 Sep 13 14:33:32.765336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1622/3334] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:32.777148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:32.777792 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:32.784147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.784739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.785242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.786028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:32.786555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:32.787047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:32.870971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:32.879289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c838dc95-366d-4262-adf3-de7276e3b964 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150970 Sep 13 14:33:32.879869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1713/3335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:32.917053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:32.925210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7718d639-7a79-4782-9207-848b4b6cc5f1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152481 Sep 13 14:33:32.925796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1623/3336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:32 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:33.739161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:33.739793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:33.746739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:33.747221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:33.747650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:33.748334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:33.748782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:33.749205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:33.791412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:33.792013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:33.798767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:33.799245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:33.799703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:33.800396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:33.800841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:33.801256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:33.883668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:33.892246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-77db47a8-b6e4-4c24-9652-6d26398e594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156914 Sep 13 14:33:33.892819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1714/3337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:33.908619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:33.909251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:33.916357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:33.916851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:33.917291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:33.918119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:33.918641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:33.919073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:34.004390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:34.013530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:34.015015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:34.016204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9553d144-6b95-47ed-8098-4cd062807534 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.229287 Sep 13 14:33:34.021681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1624/3338] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:33 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:34.025865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:34.026679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:34.033130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:34.033849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:34.034482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:34.035358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:34.036006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:34.036432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:34.060045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:34.068324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3cf69610-0258-4f83-983d-467424f7de61 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163734 Sep 13 14:33:34.068925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1715/3339] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:34.246482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:34.255302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a31db6b2-3308-44b8-9a8d-6d187f06d6c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.237583 Sep 13 14:33:34.255878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1625/3340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:34 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:34.917420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:34.918084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:34.926664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:34.927569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:34.928376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:34.929613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:34.931168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:34.931948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.043509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:35.044118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:35.050997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:35.051523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:35.051983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.052710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:35.053182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:35.053586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.066853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:35.075124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21a77087-b3a3-44b6-9d54-1e87be9d84cc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.162113 Sep 13 14:33:35.075939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1716/3341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:35.091675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:35.092668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:35.098779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:35.099367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:35.099812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.100519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:35.101002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:35.101429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.189185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:35.198798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:35.200604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:35.202130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-64e94d60-39ba-4b38-a068-a08a855b3cad tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.162774 Sep 13 14:33:35.202649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1626/3342] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:35.236931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:35.245797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e97cdcc2-5499-47b1-934c-63c24a49b7c8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157836 Sep 13 14:33:35.246366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1717/3343] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:35.278969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:35.279576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:35.285824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:35.286329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:35.286761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.287446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:35.288013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:35.288322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:35.416572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:35.424854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e49c730e-8c1e-46d7-a709-229b2a4b76eb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149625 Sep 13 14:33:35.425418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1627/3344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:35 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:36.099133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:36.099776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:36.106922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.107401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.107837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.108527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.108980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.109404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.228487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:36.229092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:36.235925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.236412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.236846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.237541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.238018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.238447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.242085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:36.250238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72e086fe-4b56-43bf-a9c7-a3077315177c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155159 Sep 13 14:33:36.250807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1718/3345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:36.269881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:36.270590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:36.272709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:36.278828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.279392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.279919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.280678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.281137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.281562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.370125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:36.379026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:36.380516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:36.381676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ef21308-5169-43e0-a492-76ef8f8a63f4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157791 Sep 13 14:33:36.382260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1628/3346] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:36.420329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:36.428524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-45dd7971-3b4d-4146-ae85-e6889b1d65f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.162376 Sep 13 14:33:36.429102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1719/3347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:36.448810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:36.449428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:36.455396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.455868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.456301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.456980 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:36.457431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:36.457876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:36.590802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:36.599073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6d10b382-0a32-43f3-9292-eb0014ef275b tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154649 Sep 13 14:33:36.599639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1629/3348] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:36 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:37.272823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:37.273557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:37.280286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.280770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.281211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.281940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.282399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.282827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.408812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:37.409418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:37.410873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:37.416468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.420155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5f19303e-dc71-4202-83ab-6780334c7060 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151616 Sep 13 14:33:37.420734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1720/3349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:37.429667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.430183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.430890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.431344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.431762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.451604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:37.452212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:37.458128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.458618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.459058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.459748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.460202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.460624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.569771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:37.579185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:37.580802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:37.582015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c46f6dfa-adfc-4571-bad5-8e487aa38eb5 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.177082 Sep 13 14:33:37.584773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1630/3350] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:37.603478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:37.611808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-35307caa-362c-4cab-bbef-3636b2b2d571 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163919 Sep 13 14:33:37.612377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1721/3351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:37.622582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:37.623227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:37.629143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.629620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.630100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:37.630784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:37.631237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:37.631658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.004508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:38.013145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d1727d5-a2d3-4e4b-abc2-0bc9c6edd0ee tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.394407 Sep 13 14:33:38.013719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1631/3352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:37 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:38.443166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:38.443721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:38.450827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:38.451287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:38.451716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.452392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:38.452841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:38.453257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.580529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:38.588769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d7fab9cc-dccd-44f9-9bfb-ac0fde61b00a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149570 Sep 13 14:33:38.589335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1722/3353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:38.608283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:38.608898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:38.615332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:38.615808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:38.616238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.616918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:38.617368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:38.618307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.636755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:38.637442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:38.643322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:38.643807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:38.644239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.644928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:38.645376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:38.645813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:38.748769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:38.757534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:38.759088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:38.760359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f7021158-1d38-4524-9bf6-942f19837dec tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155934 Sep 13 14:33:38.760915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1632/3354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:38.778699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:38.786948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3f18122f-f781-4e6f-888d-2fb81c2dc8fe tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154496 Sep 13 14:33:38.787517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1723/3355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:39.037180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:39.037845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:39.044449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.044920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.045353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.046050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.046498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.046914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.182055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:39.190145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bf973aa9-4a34-4568-a574-d9b7520110b9 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156785 Sep 13 14:33:39.190713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1633/3356] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:39 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:39.611774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:39.612388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:39.618940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.619423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.619852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.620539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.620998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.621424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.754323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:39.757698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:39.764290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3031e501-414a-4eda-8cf5-d6cce1776c61 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156379 Sep 13 14:33:39.764861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1724/3357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:39.786773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:39.787323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:39.793877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.794347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.794777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.795448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.795890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.796308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.812234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:39.812843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:39.818824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.819314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.819746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.820430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:39.821630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:39.822084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:39.923857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:39.933053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:39.934518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:39.935667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-389ad9cd-6c63-48b0-878f-ad7bbcd456c2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152807 Sep 13 14:33:39.936215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1634/3358] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:39 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:39.952627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:39.960761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-73de1640-90ab-4cac-9dea-242e05272510 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152315 Sep 13 14:33:39.961936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1725/3359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:39 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:40.214095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:40.214733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:40.220682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.221200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.221651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.222350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.222797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.223214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.474879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:40.483013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e239e67c-57f3-40ca-ab89-e480203f40d6 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.273485 Sep 13 14:33:40.483582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1635/3360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:40 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:40.789989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:40.790622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:40.796981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.797595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.797931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.798618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.799070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.799493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.932600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:40.940706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a496cbc3-800b-4f5c-bbc2-111348175e04 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154602 Sep 13 14:33:40.941273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1726/3361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:40.960409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:40.961015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:40.967827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.968302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.968732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.969417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.969899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.970330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.984671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:40.985276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:40.991083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.991566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.991996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:40.993293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:40.993762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:40.994189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:41.109907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:41.119793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:41.121568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:41.122759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:41.122950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c7e2a4e-fe7b-4009-a046-5df9c9cc07b6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.166322 Sep 13 14:33:41.123376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1636/3362] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:41.130914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b56062e9-05af-45ec-b20e-5a1d2789f916 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150082 Sep 13 14:33:41.131464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1727/3363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:41.506077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:41.506741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:41.513238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:41.513718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:41.514179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:41.514860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:41.515316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:41.515738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:41.535225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:41.646442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:41.655084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3c9f4b02-413b-48ef-a324-f24dd7b100c8 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152821 Sep 13 14:33:41.655643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1637/3364] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:41 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:41.963569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:41.964175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:41.970556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:41.971031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:41.971460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:41.972136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:41.972585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:41.973003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.099036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:42.107838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f16e9e3e-7ebe-4266-bf90-5651295a24fe tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148174 Sep 13 14:33:42.108400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1728/3365] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:42.148501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:42.149766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:42.152076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:42.155068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:42.155691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:42.157281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:42.157775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:42.158207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.158892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:42.159343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:42.159761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.161554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:42.162090 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:42.162526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.163212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:42.163668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:42.164092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.299725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:42.300346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:42.308634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a311e0f8-e7a2-4e48-af45-2fe886e50547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157575 Sep 13 14:33:42.309218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1729/3366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:42.309535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:42.311013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:42.312154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee80509a-7cd5-46ff-b65b-4bd53f469d68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.167782 Sep 13 14:33:42.312693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1638/3367] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:42.678614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:42.679218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:42.685384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:42.685902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:42.686340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.687027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:42.687481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:42.687907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:42.817741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:42.826747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3fe797a5-633f-49de-8fea-24800ba7fe08 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151962 Sep 13 14:33:42.827312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1730/3368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:42 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:43.130739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:43.131271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:43.138360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.138835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.139267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.139951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.140401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.140822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.279635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:43.287822 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3eb16cf-a8f4-4a76-8096-dea321077b6a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.161041 Sep 13 14:33:43.288389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1639/3369] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:43.332404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:43.333009 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:43.336432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:43.336851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:43.339588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.340066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.340493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.341174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.341623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.342063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.342943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.343423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.343857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.344539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.344990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.345408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.475011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:43.478463 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:43.483891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb31142f-b01c-40d0-a771-693c32ed04f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155306 Sep 13 14:33:43.484465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1731/3370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:43.486950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:43.488372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:43.489518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-41da36e0-bd5f-4fa2-b1d2-c98f0510b56f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157273 Sep 13 14:33:43.490748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1640/3371] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:43.849887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:43.850496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:43.857448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.857979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.858417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.859114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:43.859571 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:43.859997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:43.987795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:43.995907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4756a55e-f5dd-4099-8de0-18309cac388e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149844 Sep 13 14:33:43.996468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1732/3372] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:43 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:44.312429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:44.313040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:44.319434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:44.319908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:44.320341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:44.321745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:44.322201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:44.322624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:44.449298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:44.457385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b71af0a-8c84-410b-b35b-904348b6294b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148802 Sep 13 14:33:44.457985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1641/3373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:44.507356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:44.507882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:44.514640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:44.515122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:44.515405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:44.515556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:44.516014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:44.516228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:44.516685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:44.517108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:44.522098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:44.522595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:44.523033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:44.523730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:44.524186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:44.524610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:44.654508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:44.655916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:44.663968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:44.664178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cad50484-bce1-4285-9e56-f04466d5fb8c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.160596 Sep 13 14:33:44.664552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1733/3374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:44.665512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:44.666705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e20ae9f2-e8ea-40df-a63c-143af83c159c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155142 Sep 13 14:33:44.667243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1642/3375] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:45.019812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:45.020625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:45.027198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.027682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.028144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.028829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.029281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.029699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.155732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:45.163811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-910fe062-a7d1-4098-bca7-9720c6996e22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147846 Sep 13 14:33:45.164366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1734/3376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:45 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:45.482023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:45.482632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:45.489027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.489500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.489967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.490645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.491095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.491517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.620696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:45.628819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-998d603f-a4aa-45b4-af20-86a1fca61219 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151193 Sep 13 14:33:45.629381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1643/3377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:45.688482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:45.689094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:45.691118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:45.691729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:45.695510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.695997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.696435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.697160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.697465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.697963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.698098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.698401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.698533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.699080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:45.699529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:45.700034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:45.827984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:45.828154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:45.836150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-13579ecd-24a4-4e14-a639-e5a8f54df7a3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151801 Sep 13 14:33:45.836685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:45.836862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1735/3378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:45.839418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:45.840593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1568d2bf-146f-433b-bbdb-1a4ceda4f2f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153162 Sep 13 14:33:45.841147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1644/3379] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:46.186864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:46.187463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:46.193486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.193995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.194424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.195102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.195551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.195966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.325931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:46.334143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c3c54d6-9fe8-40ef-8317-7ad9f0f5c9fd tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151075 Sep 13 14:33:46.334705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1736/3380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:46 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:46.652534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:46.653140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:46.659535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.660003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.660430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.661109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.661554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.661999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.790966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:46.799125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15dd34bf-b5eb-40f1-8908-c8e12a8dc2de tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150656 Sep 13 14:33:46.799885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1645/3381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:46.860005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:46.860531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:46.865846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:46.866452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:46.866582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.867023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.867460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.868157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.868617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.869566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.872724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.873195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.873621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:46.874326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:46.874771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:46.875191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:47.004078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:47.006107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:47.013551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-daada712-eab6-40f5-809e-e8dce39b49dc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157442 Sep 13 14:33:47.014428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1737/3382] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:46 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:47.015737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:47.017203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:47.018396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b048ff4e-b7f4-4b6c-ba28-97ec8ace4348 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156333 Sep 13 14:33:47.022055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1646/3383] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:46 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:47.358769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:47.359417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:47.365883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:47.366365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:47.366798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:47.367478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:47.367932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:47.368354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:47.501406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:47.510738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b0eefd9f-c6e0-42c4-9a81-17035a86d79c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.156047 Sep 13 14:33:47.511326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1738/3384] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:47 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:47.823222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:47.823853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:47.830367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:47.830836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:47.831261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:47.832032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:47.832488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:47.832907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:47.961646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:47.970458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-abcb0b36-6102-45b4-8adf-f2068016a1e7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151695 Sep 13 14:33:47.971019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1647/3385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:48.037331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:48.037978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:48.043204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:48.043809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:48.044014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:48.044499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:48.044941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:48.045631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:48.046109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:48.046536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:48.049709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:48.050217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:48.050650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:48.051337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:48.051788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:48.052208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:48.185309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:48.185481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:48.193671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cbc71ef0-3d4b-4f5b-b2c8-db7b121078f1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.160118 Sep 13 14:33:48.194460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1739/3386] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:48.195201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:48.196832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:48.199289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0f410ca-249e-46e4-baf0-a0bac1c6df1d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160307 Sep 13 14:33:48.200002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1648/3387] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:48.534944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:48.535554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:48.542723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:48.543212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:48.543647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:48.544339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:48.544794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:48.545216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:48.670958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:48.679027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a5a5e6bb-1db2-493e-814e-ddbd3e9b166a tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147913 Sep 13 14:33:48.679590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1740/3388] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:48 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:48.992515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:48.993121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:49.000488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.000964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.033420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.033420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.033420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.033420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.141377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:49.149907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-022b9b0c-4e2a-427e-a469-c0f1bde69ab4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.161330 Sep 13 14:33:49.151244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1649/3389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:49.219435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:49.220050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:49.225376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:49.226049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.226210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:49.226535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.226967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.227658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.228118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.228739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.232914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.233474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.233999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.234772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.235300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.235800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.248850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:49.367344 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:49.374069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:49.376819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9dcab57d-534e-45ac-bb1d-86676bb1f59a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.161143 Sep 13 14:33:49.377398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1741/3390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:49.382862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:49.384295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:49.385988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-531d308b-81d3-4dd5-a8dc-1548d37ea250 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.164409 Sep 13 14:33:49.386535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1650/3391] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:33:49.703703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:49.704308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:49.710813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.711292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.711718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.712393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:49.713104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:49.713541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:49.838388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:49.847592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df905471-471e-4aaa-9c6a-ccfafe752bf4 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.147733 Sep 13 14:33:49.848155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1742/3392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:49 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:50.174071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:50.174611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:50.181263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.181994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.182428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.183108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.183563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.183983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.313433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:50.321554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-539b11f6-49c2-4044-bb57-5e691ed5669d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151439 Sep 13 14:33:50.322901 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1651/3393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:50.400369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:50.400987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:50.407076 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.407575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.408017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.408710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.409168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.409596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.410883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:50.411496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:50.417507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.418012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.418453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.419131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.419579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.419998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.544889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:50.553265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-31f4df29-2588-400e-9ffd-32a544208dee tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157041 Sep 13 14:33:50.553854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1743/3394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:50.557444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:50.566129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:50.567570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:50.568715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-05acc4a9-49a4-42e9-8bcb-6af3c42c6e5a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161658 Sep 13 14:33:50.569271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1652/3395] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:50.871991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:50.872533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:50.878934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.879423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.879861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:50.880557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:50.881014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:50.881442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.011413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:51.023139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-457b9ffd-a643-40c9-adff-2b58d42129af tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.155668 Sep 13 14:33:51.023708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1744/3396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:50 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:51.346052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:51.346661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:51.353060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:51.354225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:51.354652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.355330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:51.355778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:51.356191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.483433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:51.491532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1fe6a2d0-d8be-40ac-bdae-4f5d61d2b729 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149307 Sep 13 14:33:51.492097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1653/3397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:51.576799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:51.577414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:51.583386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:51.583871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:51.584309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.584996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:51.585454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:51.585925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.594080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:51.594755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:51.600664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:51.601145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:51.601571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.602278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:51.602722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:51.603200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:51.607393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:51.720768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:51.731962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-592bc908-25ac-4a4b-b1ca-19859e13032e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156188 Sep 13 14:33:51.731962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1745/3398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:51.732115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:51.740649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:51.742195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:51.743341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ae1b367-423b-40e7-8bac-e2dbce78f081 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153060 Sep 13 14:33:51.744432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1654/3399] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:52.047827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:52.048364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:52.054785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.055272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.055709 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.056892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.057350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.057800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.183912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:52.191932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5595b656-db03-41c1-bbd7-7bbdc5ed51ba tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148123 Sep 13 14:33:52.192505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1746/3400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:52 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:52.514867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:52.515586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:52.522308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.522788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.523219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.523907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.524360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.524781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.657754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:52.666441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4acb0eff-f4fa-4a43-9606-ee2702a260b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154857 Sep 13 14:33:52.667125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1655/3401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:52.752180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:52.752782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:52.758692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.759167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.759625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.760312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.760765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.761178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.768050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:52.768652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:52.774754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.775755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.776186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.776872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:52.777317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:52.777763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:52.891122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:52.899632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c9ad0b35-0faf-49a9-8f05-0e9c16d3dc1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151199 Sep 13 14:33:52.901141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1747/3402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:52 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:52.910501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:52.919445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:52.920912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:52.922085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d230089-549b-4545-8bb4-f9731d85da5f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157793 Sep 13 14:33:52.922644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1656/3403] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:52 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:53.215483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:53.216133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:53.222631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.223118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.223556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.224250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.224708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.225134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.376055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:53.384990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08dea37e-e001-4770-b65f-f5a15edb4ead tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.173695 Sep 13 14:33:53.385598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1748/3404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:53 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:53.690166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:53.690774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:53.697061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.697722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.698181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.698877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.699328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.699785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.844132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:53.854099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-291524aa-105a-49fd-a939-387cc3a864e2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.167220 Sep 13 14:33:53.854673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1657/3405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:53.923298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:53.923935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:53.929910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.930386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.930816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.932147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.932626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.933048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.947412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:53.948058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:53.954131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.954620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.955055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:53.955757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:53.956213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:53.956637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:54.061115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:54.069349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-59695882-5674-45b6-a7aa-8ce104e7b348 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149925 Sep 13 14:33:54.070055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1749/3406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:54.086588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:54.096243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:54.097705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:54.098866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c935b83b-9f54-4e7d-b56d-6a8461fa993c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155533 Sep 13 14:33:54.099423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1658/3407] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:54.410401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:54.410961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:54.417356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:54.417861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:54.418292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:54.419004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:54.419452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:54.419870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:54.792333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:54.800514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ef4daec9-9295-4704-b5df-c520ec1d689e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.394175 Sep 13 14:33:54.801084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1750/3408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:54 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:54.878602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:54.879207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:54.886495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:54.886977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:54.887415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:54.888105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:54.888563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:54.888989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.023384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:55.031913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c8b7d9b7-f921-4c80-99a3-b77adddf4553 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157093 Sep 13 14:33:55.032476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1659/3409] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:55.092519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:55.093064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:55.099145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:55.099625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:55.100061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.100749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:55.101211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:55.101637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.124754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:55.125394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:55.131234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:55.131719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:55.132146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.132830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:55.133282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:55.133702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.235718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:55.244877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cae1939c-be19-4199-a049-828f85afa1a9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155444 Sep 13 14:33:55.245960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1751/3410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:55.269435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:55.278503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:55.279939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:55.281090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d59d25d2-d5e1-40f4-8019-130b9664f670 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160229 Sep 13 14:33:55.281641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1660/3411] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:55 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:55.824892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:55.825428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:55.831754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:55.832210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:55.832640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.833320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:55.833787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:55.834208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:55.962969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:55.971105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b4d167a2-468d-4c9e-aea2-2fcc8237840f tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150419 Sep 13 14:33:55.971672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1752/3412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:55 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:56.055032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:56.055631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:56.062349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:56.062821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:56.063251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:56.063930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:56.064381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:56.064797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:56.202844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:56.211011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b84fe8e0-af29-44a2-a71b-037877929737 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.159744 Sep 13 14:33:56.211584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1661/3413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:56.268517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:56.269128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:56.275537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:56.276031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:56.276464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:56.277151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:56.277604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:56.278054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:56.306842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:56.307715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:56.313671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:56.314185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:56.314621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:56.315316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:56.315771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:56.316273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:56.406403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:56.414704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e835ddca-2d71-4fd0-ab6f-269428ea95d1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149992 Sep 13 14:33:56.415278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1753/3414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:56.450410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:56.458985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:56.460437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:56.461588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fd14169-427d-4fc3-9861-6fd797eae1f7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159184 Sep 13 14:33:56.462181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1662/3415] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:56 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:56.994216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:56.994826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:57.001504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.002029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.002460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.003143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.003593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.004008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.130819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:57.139624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e95d3a93-00dc-4e48-8804-24a9aef80103 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149791 Sep 13 14:33:57.140181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1754/3416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:56 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:57.234667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:57.235274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:57.241672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.242180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.242611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.243295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.244240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.244844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.372221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:57.380359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e6bf6ebe-f566-422b-9a0b-33630888f811 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149500 Sep 13 14:33:57.380926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1663/3417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:33:57.438551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:57.439161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:57.445041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.445518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.445997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.446689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.447146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.447567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.487313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:57.487897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:57.494475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.494958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.495388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.496090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:57.496523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:57.496945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:57.581601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:57.590646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da0e76db-16b3-45d6-aff4-6ee883d71bbb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156075 Sep 13 14:33:57.591231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1755/3418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:57.633469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:57.642283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:57.643726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:57.644880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51f2cd7d-f92b-488a-9b08-98c20db03a0c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161546 Sep 13 14:33:57.645429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1664/3419] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:57 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:58.163332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:58.163948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:58.170828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.171313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.171754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.172446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.172904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.173332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.299715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:58.307851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-467a52c6-a69a-4a45-8682-4034127f9e9e tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148373 Sep 13 14:33:58.308407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1756/3420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:58 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:58.404373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:58.404986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:58.411444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.411915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.412347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.413029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.413531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.413929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.541972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:58.550242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a0e321fc-7652-497b-ae04-b12b59d9ae0e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150481 Sep 13 14:33:58.550804 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1665/3421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:58.614270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:58.614882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:58.621802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.622292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.622733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.623424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.623874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.624304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.671786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:58.672353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:58.678384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.678864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.679300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.679984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:58.680480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:58.680846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:58.757532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:58.766944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f6d08c90-6197-4f11-a8d3-77afa663e320 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.156556 Sep 13 14:33:58.767818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1757/3422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:58 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:58.816611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:58.825821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:58.827292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:58.828438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f812fa8-be34-4bec-a0de-5288ba3b59f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160633 Sep 13 14:33:58.828986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1666/3423] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:58 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:33:59.332188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:59.332792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:59.339863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.340339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.340765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.341443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.341925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.342346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.346275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:33:59.468493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:59.476542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b7156d14-8480-4144-9117-b97a9c2d1d22 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.148346 Sep 13 14:33:59.477115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1758/3424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:59 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:59.573908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:59.574541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:59.581064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.581540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.582015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.582745 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.583152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.583572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.716512 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:59.728660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-120390b5-befb-46b3-b0ed-ec2547c9af7c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158556 Sep 13 14:33:59.730056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1667/3425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:33:59.791489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:59.792117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:59.798242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.798813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.799185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.799860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.800312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.800733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.854418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:33:59.854952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:33:59.871810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.872411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.872920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.873849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:33:59.874375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:33:59.874867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:33:59.937425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:33:59.949128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-32b228a8-8fba-42e1-a399-9aae034aaea4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.162223 Sep 13 14:33:59.949703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1759/3426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:33:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:00.013334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:00.022194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:00.023644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:00.024814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-43f56925-fcc2-4ad3-9f71-2514c669927c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.174744 Sep 13 14:34:00.025573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1668/3427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:33:59 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:00.500306 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:00.500912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:00.507346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:00.507825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:00.508252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:00.508957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:00.509408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:00.509963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:00.638184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:00.646290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-feba07a3-8d42-4edc-88dc-9e1f2bcc4ddb tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149893 Sep 13 14:34:00.647097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1760/3428] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:00 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:00.751441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:00.751978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:00.758571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:00.759076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:00.759500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:00.760380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:00.760835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:00.761280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:00.893783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:00.903389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bdc47152-2a6e-41b2-83f1-45bf136c57ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155838 Sep 13 14:34:00.903954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1669/3429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:00.972342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:00.972968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:00.980138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:00.980624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:00.981062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:00.981773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:00.982238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:00.982670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:01.049475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:01.050025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:01.056044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:01.056522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:01.056998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:01.057710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:01.058290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:01.058579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:01.110922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:01.119327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69419072-ac7b-4669-9bc7-0c8eb864f93a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150820 Sep 13 14:34:01.120124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1761/3430] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:01.187903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:01.191278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:01.197575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:01.199035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:01.200221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae8f1966-b21e-4936-ac17-7fb1a36768c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154786 Sep 13 14:34:01.200784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1670/3431] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:01 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:01.669504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:01.670161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:01.676487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:01.676961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:01.677389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:01.678099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:01.678549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:01.678969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:01.810065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:01.818116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3300586a-2743-44ed-af45-5222fecdc6c2 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152531 Sep 13 14:34:01.818674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1762/3432] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:01 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:01.928023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:01.928658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:01.935830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:01.936318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:01.936749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:01.937438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:01.937929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:01.938348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.069162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:02.077452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f26077f-8b50-47e2-a31a-b6c447884cb2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153528 Sep 13 14:34:02.078052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1671/3433] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:01 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:02.142982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:02.143592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:02.149713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:02.150229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:02.150660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.151346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:02.151802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:02.152227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.225758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:02.226368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:02.232981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:02.233454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:02.233912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.234597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:02.235046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:02.235465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.284947 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:02.294169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d3cd687-b398-4430-b30f-0da653875164 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154917 Sep 13 14:34:02.294748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1763/3434] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:02.365869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:02.374837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:02.376307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:02.377488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f8e76dbb-9574-4c73-b218-d837b3419d51 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155629 Sep 13 14:34:02.378068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1672/3435] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:02 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:02.842458 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:02.843061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:02.849393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:02.849911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:02.850339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.851016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:02.851465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:02.851885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:02.990343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:03.000950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-38716800-d032-4797-88ae-c42890cf7243 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.162283 Sep 13 14:34:03.001522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1764/3436] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:02 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:03.099802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:03.100395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:03.107089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:03.107565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:03.107999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:03.108683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:03.109133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:03.109556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:03.237204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:03.245871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec909e0e-661c-41cf-95ec-8d085a985a2b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150012 Sep 13 14:34:03.246433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1673/3437] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:03.316472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:03.317110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:03.323618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:03.324091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:03.324522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:03.325194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:03.325642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:03.326102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:03.402673 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:03.403418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:03.409363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:03.409879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:03.410319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:03.411018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:03.411473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:03.411895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:03.452975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:03.461316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ef917d6-04bc-4b8d-beec-2933b8b52479 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148589 Sep 13 14:34:03.461888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1765/3438] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:03.544412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:03.553068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:03.554561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:03.555749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17bd1c3f-5ce5-49e9-b51b-41b9cec75c32 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156979 Sep 13 14:34:03.557060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1674/3439] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:03 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:04.027506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:04.028114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:04.034651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.035126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.035555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.036229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.036676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.037093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.165876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:04.173921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7d702d77-5d40-467d-9695-0e142f6a8785 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.150791 Sep 13 14:34:04.174476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1766/3440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:04 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:04.269396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:04.269962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:04.277254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.277736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.278177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.278851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.279297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.279712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.404353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:04.412826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-92e2fd9e-b519-4f03-8cc0-cc37a0b8e487 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147244 Sep 13 14:34:04.413384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1675/3441] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:04.484954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:04.485569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:04.491511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.491994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.492433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.493118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.494121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.494546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.580526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:04.581123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:04.587282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.587773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.588270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.588954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:04.589404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:04.589849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:04.625092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:04.633638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-de215002-f6d5-4144-b992-ea10bf78c6f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152483 Sep 13 14:34:04.634945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1767/3442] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:04.731281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:04.739811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:04.741248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:04.742427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88cfbea0-727b-4dcd-98f5-51f2a50e8bff tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.165983 Sep 13 14:34:04.742989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1676/3443] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:04 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:05.196955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:05.197501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:05.203990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.204480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.204913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.205637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.206123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.206547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.336188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:05.345158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-20a67b30-24e9-4328-abd1-0099613edc82 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152155 Sep 13 14:34:05.345722 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1768/3444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:05 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:05.435092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:05.435713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:05.442428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.442904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.443335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.444014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.444459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.444876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.571372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:05.579592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fd0babe1-32c0-4036-905e-c2e0a343d958 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148332 Sep 13 14:34:05.580159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1677/3445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:05.658566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:05.659183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:05.661004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:05.666758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.667241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.667676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.668357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.668806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.669236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.768601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:05.769361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:05.776137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.776688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.777118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.777823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:05.778275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:05.778699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:05.800657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:05.809149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cfeeb8ab-0e37-438a-b27c-bc3c8eba0f05 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154391 Sep 13 14:34:05.809744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1769/3446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:05 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:05.904391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:05.912931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:05.914428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:05.916238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-765b1cf6-353c-429a-8ae8-71983225ba70 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.151100 Sep 13 14:34:05.916795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1678/3447] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:05 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:06.368799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:06.369312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:06.375754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.376233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.376668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.377360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.377848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.378277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.506715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:06.515712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f9c70b9-22af-4e32-af79-679c2c40e3aa tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.151196 Sep 13 14:34:06.516286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1770/3448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:06 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:06.601781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:06.602403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:06.610625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.611103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.611560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.612227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.613183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.613183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.742094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:06.750765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-177974c9-8edc-4fc4-b9f1-13bd5c5bfe5f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152812 Sep 13 14:34:06.751333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1679/3449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:06.832777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:06.833388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:06.839247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.839729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.840196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.840876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.841328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.841773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.941336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:06.941968 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:06.948309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.948787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.949215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.949933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:06.950394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:06.950801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:06.970397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:06.979110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46e89cad-d6e3-4084-beec-8c24de6c815f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150141 Sep 13 14:34:06.979678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1771/3450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:07.078473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:07.086940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:07.088398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:07.089534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d8a77e7c-ac71-44ab-a8ac-13a91bfdbec6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.152065 Sep 13 14:34:07.090107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1680/3451] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:06 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:07.539032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:07.539676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:07.546946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:07.547426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:07.547862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:07.548549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:07.549003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:07.549428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:07.678565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:07.687304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a6fb4886-3a4d-4841-b70b-8dc3f60ac208 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152169 Sep 13 14:34:07.687871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1772/3452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:07 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:07.774206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:07.774990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:07.781539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:07.782002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:07.782435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:07.783117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:07.783570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:07.783989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:07.912991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:07.921832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cf77e9e9-3934-4805-9ac7-0736b9dc1c40 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151665 Sep 13 14:34:07.922401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1681/3453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:08.008684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:08.009301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:08.015332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.015824 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.016264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.016957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.017416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.017870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.115344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:08.115948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:08.122012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.122489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.122922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.123607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.124057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.124479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.146056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:08.155177 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a7afe60b-c1e1-40a4-a060-2300ff7fdb3a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150319 Sep 13 14:34:08.155746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1773/3454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:08.253420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:08.262841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:08.264393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:08.265540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f0d92e3-b36c-4512-8eb4-36ce17014257 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154179 Sep 13 14:34:08.266142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1682/3455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:08 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:08.710277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:08.710895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:08.717315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.717828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.718272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.718965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.719422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.719847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.849667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:08.853343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:08.859083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca657a9b-0677-4d97-889c-721a2ebf0f26 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152707 Sep 13 14:34:08.859647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1774/3456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:08 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:08.944495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:08.945437 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:08.952126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.952605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.953037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:08.953722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:08.954199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:08.954622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:09.083141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:09.091408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a2ae23db-5477-4f5b-9c73-4369d1cf296f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150742 Sep 13 14:34:09.091981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1683/3457] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:08 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:09.178668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:09.179269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:09.185746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:09.186234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:09.186667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:09.187338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:09.187790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:09.188206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:09.292151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:09.292832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:09.298761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:09.299568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:09.299676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:09.300499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:09.300950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:09.301366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:09.316919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:09.325269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee4b9260-1eac-41af-b944-668efe6f1ef9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150695 Sep 13 14:34:09.326054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1775/3458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:09.430489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:09.439050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:09.440505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:09.441637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8ca29a3-a754-49a6-b06c-c5f43f491d47 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154115 Sep 13 14:34:09.442215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1684/3459] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:09 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:09.884421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:09.885110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:09.891691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:09.892206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:09.892643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:09.893329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:09.893809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:09.894239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.025937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:10.034334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f424c042-0267-4fea-bb7e-600fde3f6c12 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154338 Sep 13 14:34:10.034913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1776/3460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:09 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:10.114883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:10.115487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:10.122187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:10.122659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:10.123083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.123785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:10.124229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:10.124644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.259845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:10.269185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1c8f399b-6776-40c6-9153-4e0d26ca148f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158180 Sep 13 14:34:10.269761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1685/3461] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:10.348436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:10.349085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:10.355165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:10.355652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:10.356087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.356768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:10.357251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:10.357674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.466608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:10.467137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:10.473249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:10.473752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:10.474294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.474988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:10.475438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:10.475860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:10.487162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:10.496568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-71776f76-d1e4-4383-a563-590f159318a0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152028 Sep 13 14:34:10.497143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1777/3462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:10.610110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:10.619291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:10.620726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:10.621892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a9eb8e7-aed6-4463-a3e2-b9dc6023c771 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159214 Sep 13 14:34:10.622448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1686/3463] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:10 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:11.056921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:11.057561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:11.064180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.064657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.065084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.065794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.066247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.066677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.193603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:11.202071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-65a4a650-5c8b-41e6-ae17-07e2b6968c0c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149013 Sep 13 14:34:11.202623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1778/3464] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:11 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:11.292375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:11.292976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:11.299360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.299830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.300258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.300930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.301378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.301835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.319461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:11.431944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:11.440094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9a9c0970-50a3-4820-95a5-b4bdbc936838 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151660 Sep 13 14:34:11.440661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1687/3465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:11.532286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:11.532931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:11.538884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.539367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.539799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.540596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.541050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.541474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.646004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:11.646662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:11.648748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:11.654953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.655434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.655872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.656573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:11.657025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:11.657484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:11.674231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:11.682910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d96b0f52-5864-4360-8d4c-d15f9ba9d73a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155037 Sep 13 14:34:11.683481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1779/3466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:11 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:11.787010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:11.795729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:11.797169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:11.798345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea33ba11-f3cd-4c85-b03d-d89c17293ba2 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156323 Sep 13 14:34:11.798908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1688/3467] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:11 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:12.225771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:12.226382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:12.233289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.233799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.234237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.234924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.235379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.235801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.366693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:12.375756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0cb62672-ba74-4748-b172-8538ef29dc79 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153924 Sep 13 14:34:12.376319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1780/3468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:12 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:12.463997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:12.464627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:12.471279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.471748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.472175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.472849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.473311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.473707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.601908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:12.610989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3089828-94a6-43a5-bd5b-de6b68f53d12 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151534 Sep 13 14:34:12.611550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1689/3469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:12 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:12.705636 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:12.706273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:12.712715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.713189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.713617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.714327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.714778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.715198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.824283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:12.825019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:12.831154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.831634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.832071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.832763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:12.833217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:12.833642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:12.845189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:12.855715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c2e1397c-5e65-4c9d-a17e-230391af21ff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153723 Sep 13 14:34:12.856223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1781/3470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:12.960639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:12.969837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:12.971273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:12.972418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2da4374-ab98-4204-b44c-51f3444c8aeb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153214 Sep 13 14:34:12.972979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1690/3471] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:12 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:13.399236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:13.399869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:13.406434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:13.406915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:13.407350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:13.408038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:13.408492 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:13.408911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:13.541015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:13.549302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b9594e6-b5a2-4b52-b7e7-ecb700d2fce1 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154323 Sep 13 14:34:13.549885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1782/3472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:13 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:13.633509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:13.634185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:13.640557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:13.641034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:13.641467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:13.642177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:13.642628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:13.643049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:13.771669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:13.780240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15c7e961-274d-433b-8509-c5746ef5bdf5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150541 Sep 13 14:34:13.780809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1691/3473] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:13.878909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:13.879545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:13.885509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:13.886048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:13.886483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:13.887157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:13.887606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:13.888022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:13.997751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:13.998356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:14.004217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:14.004691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:14.005114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:14.005821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:14.006269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:14.006684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:14.015986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:14.024885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ddbf29f7-68cd-42fd-8b4c-762e64688565 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149267 Sep 13 14:34:14.025459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1783/3474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:14.133703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:14.142125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:14.143548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:14.144681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6da045f4-7108-4015-8ec6-e8ccb9cc5ddb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150861 Sep 13 14:34:14.145239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1692/3475] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:13 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:14.573190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:14.573883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:14.580644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:14.581201 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:14.581702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:14.582413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:14.582859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:14.583278 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:14.718349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:14.726390 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c53b173d-bde8-41a7-bbfa-c8edfa50c281 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.157909 Sep 13 14:34:14.726954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1784/3476] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:14 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:14.804747 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:14.805285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:14.812233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:14.812701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:14.813132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:14.813852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:14.814300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:14.814790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:14.856125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:34:14.856314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:34:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed (ip 10.222.0.20) !!! Sep 13 14:34:14.944776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:14.953923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4b8cde7a-9bb5-41c3-80bc-b97ab64da0d7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153049 Sep 13 14:34:14.954485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1693/3477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:15.048481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:15.049101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:15.055114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.055544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.056530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.057427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.057922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.058349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.170834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:15.171440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:15.177238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.177714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.178177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.178866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.179321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.179743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.187061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:15.195096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4d894e0c-602a-4af1-b43f-33113e791ad7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150518 Sep 13 14:34:15.195671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1785/3478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:15 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:15.311494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:15.320025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:15.321482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:15.322646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6184f6a2-8d9d-4152-be85-a74c4cd1bef9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155714 Sep 13 14:34:15.323201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1694/3479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:15 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:15.748207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:15.748838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:15.755260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.755735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.756158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.756832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.757279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.757695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.889014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:15.897395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da597e93-d82a-4625-8bb6-3154d64a343c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.152751 Sep 13 14:34:15.898051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1786/3480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:15 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:15.977056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:15.977896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:15.984292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.984772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.985203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:15.985926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:15.986376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:15.986797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:16.117052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:16.126241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9fd58af1-3386-49f4-946c-ced1e3712ac0 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153058 Sep 13 14:34:16.126814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1695/3481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:16.220060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:16.220666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:16.226666 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:16.227135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:16.227870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:16.228648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:16.229098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:16.229520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:16.347134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:16.347735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:16.353612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:16.354125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:16.354551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:16.355232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:16.355677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:16.356092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:16.356255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:16.364580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-de6e449c-f1c9-4577-9eb0-a171179c8b8b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148295 Sep 13 14:34:16.365156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1787/3482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:16 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:16.481640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:16.490174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:16.491624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:16.492776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26c45d1a-bd5f-465b-ae7d-de5e41b8c161 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.149532 Sep 13 14:34:16.493881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1696/3483] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:16 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:16.921024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:16.921643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:16.927555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:16.928038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:16.928476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:16.929157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:16.929613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:16.930064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.011621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:34:17.011773 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:34:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 (ip 10.222.0.20) !!! Sep 13 14:34:17.063017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:17.071221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ede9e3df-dd24-44db-b7bf-fa2977dfba6d tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.154001 Sep 13 14:34:17.071787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1788/3484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:16 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:17.148511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:17.149106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:17.156212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:17.156680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:17.157105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.157799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:17.158274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:17.158688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.285446 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:17.293958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-91e854d1-7762-47b4-a168-bfd35e6ee22c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149459 Sep 13 14:34:17.294516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1697/3485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:17.389052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:17.389659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:17.396018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:17.396497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:17.397188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.397902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:17.398357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:17.398780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.519783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:17.520559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:17.529847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:17.535450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:17.535850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:17.536276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.536964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:17.537442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:17.537890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:17.538254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dd9fe694-13f5-44f7-b251-d14b02734e1f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153202 Sep 13 14:34:17.538832 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1789/3486] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:17 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:17.669081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:17.677594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:17.679057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:17.680189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dca8120a-4e64-44c8-b4e5-4d9bef78a5e4 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.164638 Sep 13 14:34:17.680826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1698/3487] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:17 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:18.094139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:18.094679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:18.100667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.101179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.101617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.102384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.102853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.103287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.231160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:18.239268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e3975f6-1675-48b8-a7bc-0ba0e4e5a983 tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.149040 Sep 13 14:34:18.239829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1790/3488] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:18 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:18.317313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:18.317946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:18.324989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.325465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.325934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.326614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.327062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.327480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.516514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:18.525060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0cfe3067-760a-4ff7-b7b6-f4e67ab1459e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.211525 Sep 13 14:34:18.525856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1699/3489] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:18.561985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:18.562594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:18.568938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.569417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.569893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.570575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.571036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.572026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.589939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:18.703382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:18.705509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:18.706150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:18.711597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bb72265b-c809-4949-b130-ad5e254a1544 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153442 Sep 13 14:34:18.712165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1791/3490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:18 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:18.712295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.712908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.713350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.714083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.714545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.714975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.831654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:18.832153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:18.838496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.838984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.839450 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.840142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.840598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.841027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.848083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:18.858908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:18.860349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:18.861564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1a6afd77-f073-4f7f-a713-a7ae25d82086 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.159898 Sep 13 14:34:18.865768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1700/3491] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:18 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:18.866993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:34:18.948779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eb494731-4b50-4fb7-b54a-5ec6cddf3118 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 204 len: 0 microversion: 2.1 time: 0.122318 Sep 13 14:34:18.949373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1792/3492] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:34:18 2022] DELETE /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:34:18.957917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:18.958592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:18.965775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.966251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.966675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:18.967351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:18.967795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:18.968209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.098385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:19.107434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1b05e543-db45-4f58-83ef-d71bab56e62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1720 microversion: 2.1 time: 0.153909 Sep 13 14:34:19.107993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1701/3493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:19.263525 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:19.264229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] [instance: 1a4a1cd1-4081-43bb-ab56-1944c8161e09] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:19.270338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.270817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.271241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.272181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.272630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.273043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.403581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4eccc7ece24cf4bcfee361d3342a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07cb899fe6934c27820d1329375e044d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:19.411970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-06b466ad-772a-4504-90bb-45a2acfa6b2c tempest-VolumesSnapshotTestJSON-752431783 tempest-VolumesSnapshotTestJSON-752431783-project] 10.222.0.20 "GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09" status: 200 len: 1560 microversion: 2.1 time: 0.153429 Sep 13 14:34:19.412535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1793/3494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:19 2022] GET /compute/v2.1/servers/1a4a1cd1-4081-43bb-ab56-1944c8161e09 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:19.547236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:19.547974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:19.554507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.554984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.556110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.556805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.557288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.557709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.687118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:19.695201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a8729f4e-875a-4b43-a28a-a6e5ad3f55dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151858 Sep 13 14:34:19.695768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1702/3495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:19 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:19.734687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:19.735325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:19.741775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.742272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.742715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.744101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.744606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.745118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.888026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:19.889295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:19.897377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:19.901903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.902383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.902830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.903549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:19.904002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:19.906060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:19.908092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6203217a-05f3-4479-865d-eae82c0c6169 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.177167 Sep 13 14:34:19.908670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1794/3496] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:19 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:20.131756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:20.132369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:20.139382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.139866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.140321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:20.141063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.141513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.141961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:20.148976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:20.158647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:20.160228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:20.161606 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-beba6c64-1dc7-486f-9b4a-d605fc874035 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.277892 Sep 13 14:34:20.162264 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1703/3497] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:19 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:20.285116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:20.293970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-779bd696-6f1b-4a07-90eb-2d73d2b3e9f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1720 microversion: 2.1 time: 0.166309 Sep 13 14:34:20.294600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1795/3498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:20.720044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:20.721590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:20.742229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.743449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.744152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:20.744936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.745803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.746614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:20.806427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c77e04fe-3528-40f8-8efb-515a6abe4a83", "name": "network-vif-deleted", "tag": "7edcac2b-89f0-4449-b10d-3e2dbafe596d"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:34:20.819221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.820033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.820953 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:20.825860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:20.835427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] Creating event network-vif-deleted:7edcac2b-89f0-4449-b10d-3e2dbafe596d for instance c77e04fe-3528-40f8-8efb-515a6abe4a83 on hv-cinder-85743 Sep 13 14:34:20.840256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR oslo.messaging._drivers.impl_rabbit [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] [5d9fd44d-763b-427e-8917-b5cbfdee66bd] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 14:34:20.931116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:20.940122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d94ff226-3eeb-42d1-a086-f97f65eda185 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.225415 Sep 13 14:34:20.953752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1796/3499] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:20.953752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:20.953752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:20.968563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.969075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.969524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:20.970266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:20.970728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:20.973836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:21.110739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:21.119265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-93bcdd16-ea3b-4d18-acb5-613e81332812 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.177015 Sep 13 14:34:21.119836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1797/3500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:20 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:21.187029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:21.187633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:21.193597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:21.194115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:21.194542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:21.195220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:21.195677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:21.196690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:21.325414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:21.334061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:21.335600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:21.337575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c623a4c3-3cf4-4c2f-b016-dc51420bbc48 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153721 Sep 13 14:34:21.338432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1798/3501] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:21 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:21.359299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:21.359930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:21.365941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:21.366453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:21.366892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:21.367591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:21.368213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:21.368712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:21.434129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:21.442645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-420aa0cf-c041-40c4-b26d-b80247a9fc87 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087904 Sep 13 14:34:21.443217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1799/3502] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:21.847376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] [5d9fd44d-763b-427e-8917-b5cbfdee66bd] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46114. Sep 13 14:34:21.853054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-ae9aa4ef-58ff-4e39-9b94-4cbf17f001b2 req-805de8e6-4bb1-4360-9484-c32e78f85f12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.151678 Sep 13 14:34:21.853663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1704/3503] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:34:21.964552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:21.965165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:21.971651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:21.972134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:21.972567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:21.973280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:21.973753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:21.974178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.099620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:22.108159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a1ec7a4e-513d-4d6b-abfe-cf226f903a5a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147731 Sep 13 14:34:22.108715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1800/3504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:22.143381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:22.144076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:22.150941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:22.151417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:22.151848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.152528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:22.152977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:22.153402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.280805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:22.289137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1211fcdb-0bd6-4309-ac78-b9977e9ed642 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149941 Sep 13 14:34:22.290394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1705/3505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:22 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:22.366810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:22.367339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:22.373259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:22.373769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:22.374206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.374884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:22.375331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:22.375747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.466989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:22.467601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:22.473766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:22.474261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:22.474694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.475390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:22.475844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:22.476269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:22.504624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:22.513747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:22.515191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:22.516351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a3ea2b2e-2ceb-4f87-a5eb-9e83b2794a9b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153470 Sep 13 14:34:22.516916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1801/3506] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:22 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:22.540101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:22.548354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-19e46165-64b8-428e-9a51-8e2914d84239 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085505 Sep 13 14:34:22.548921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1706/3507] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:23.132427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:23.133041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:23.140116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.140596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.141032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.141769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.142227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.142652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.275183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:23.283467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0303aee0-971d-4a03-9ab2-5bb44c06ac41 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154999 Sep 13 14:34:23.284032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1802/3508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:23.313145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:23.313777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:23.319902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.320381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.320816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.321509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.321993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.322421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.452632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:23.460714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4c5a677d-0324-49bf-9436-df2f3a695282 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151443 Sep 13 14:34:23.461273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1707/3509] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:23 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:23.543407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:23.544043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:23.550016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.550487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.550914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.551593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.552041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.552460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.570702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:23.571391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:23.577412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.578004 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.578443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.579137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:23.579586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:23.580005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:23.642851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:23.652061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a00c877a-7ebe-4361-a18a-57f98ddd55a3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085120 Sep 13 14:34:23.652663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1708/3510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:23.683942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:23.692541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:23.694002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:23.695140 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53a06ff0-427e-4cbd-8920-0ed601961d9a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156506 Sep 13 14:34:23.695683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1803/3511] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:23 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:24.307474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:24.308095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:24.314070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.314624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.314973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.315664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.316120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.316545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.442995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:24.451888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-06f36ca9-c753-4a4c-9235-539aefd73ba5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148818 Sep 13 14:34:24.452472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1709/3512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:24.483626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:24.484236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:24.490577 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.491057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.491488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.492169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.492620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.493668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.624765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:24.632909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d6ead070-5c18-4c0f-8f2e-aeab565eebbf tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153053 Sep 13 14:34:24.634131 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1804/3513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:24 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:24.675414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:24.676024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:24.682472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.682950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.683382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.684065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.684514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.684934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.720341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:24.720950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:24.727023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.727514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.727941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.728637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:24.729092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:24.729515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:24.748262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:24.756499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-478a0327-d642-483b-b43f-c5c6cc2879be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084941 Sep 13 14:34:24.757069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1710/3514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:24.858981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:24.867481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:24.869669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:24.870845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd36c3f8-c820-496d-a2d9-e1dd847b5c24 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154321 Sep 13 14:34:24.871401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1805/3515] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:24 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:25.475231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:25.475871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:25.483094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.483577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.484014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.484702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.485158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.485611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.613872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:25.622018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-253b7ccf-7fbb-4b05-b3e6-9cc80fa5cf8f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150672 Sep 13 14:34:25.622586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1711/3516] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:25 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:25.656370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:25.656985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:25.663369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.663845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.664276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.664957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.665405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.665853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.683772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:25.780985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:25.781585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:25.787521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.788002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.788470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.789122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.789621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.790237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.796012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:25.804526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8fe1c442-5d7e-42d4-82f8-19db84c0e693 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152014 Sep 13 14:34:25.805449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1806/3517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:25 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:25.853932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:25.862333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ff86150d-f8f4-4904-9cbb-f19a877ef720 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085192 Sep 13 14:34:25.862938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1712/3518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:25.895962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:25.896560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:25.903896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.904381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.904812 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:25.905497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:25.905984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:25.906408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.037544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:26.046297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:26.047747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:26.048981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3ab68b8-917e-4b23-9c79-9f18672decaf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.156877 Sep 13 14:34:26.049535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1807/3519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:25 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:26.645551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:26.646215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:26.653460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:26.653975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:26.654408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.655090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:26.655542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:26.655962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.783675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:26.792333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5494ce0-7d83-4ebe-95f1-0ed766e9324f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150637 Sep 13 14:34:26.792897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1713/3520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:26.828004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:26.828614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:26.835118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:26.835591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:26.836020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.837457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:26.837941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:26.838362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.884421 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:26.885026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:26.891058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:26.891542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:26.891975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.892678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:26.893126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:26.893550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:26.955513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:26.964468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6fc55435-3cd5-4163-aca8-363a00938f91 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083938 Sep 13 14:34:26.965045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1714/3521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:26.979491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:26.987725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-870956e1-a428-4993-af87-9d882c8f4fa1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.163613 Sep 13 14:34:26.988281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1808/3522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:26 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:27.074701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:27.075275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:27.081395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:27.081914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:27.082350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:27.083033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:27.083483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:27.083903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:27.211340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:27.220491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:27.221969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:27.223129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c31c3560-df3c-4d8c-95fc-353e8c8960d7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.153210 Sep 13 14:34:27.223683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1715/3523] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:27 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:27.815466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:27.816004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:27.823107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:27.823595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:27.824032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:27.824721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:27.825179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:27.825611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:27.956890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:27.965620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-722262c6-64f5-4344-b31c-a6b94df5c546 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154147 Sep 13 14:34:27.966197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1809/3524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:27.987632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:27.988236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:27.994631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:27.995086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:27.995519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:27.996198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:27.996646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:27.997063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:28.010142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:28.010745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:28.016672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:28.017147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:28.017574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:28.018280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:28.018729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:28.019148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:28.061778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:28.069988 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e7e9c4ac-aaaf-44a4-a3c4-df8a11f98898 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086042 Sep 13 14:34:28.070497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1716/3525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:28.146056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:28.155125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-70d725f1-3c25-4d07-85b9-0f3aeb218688 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.149281 Sep 13 14:34:28.155694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1810/3526] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:28 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:28.248494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:28.249122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:28.254969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:28.255439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:28.255863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:28.256535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:28.256981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:28.257398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:28.381676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:28.391010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:28.392529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:28.393675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b23ed491-8dc8-4905-beb6-0a65a9eb4bee tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.149244 Sep 13 14:34:28.394278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1717/3527] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:28 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:28.988529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:28.989133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:28.996260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:28.996733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:28.997160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:28.997863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:28.998314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:28.998731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.093242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:29.093894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:29.100474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:29.100951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:29.101380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.102772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:29.103232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:29.103656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.132118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:29.141089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-be4832a9-5ac4-4b9a-8ca5-7b361ead38fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156355 Sep 13 14:34:29.141659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1811/3528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:29.167133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:29.175306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a67e4b61-d769-477a-9d25-4525020f8c70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085930 Sep 13 14:34:29.175871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1718/3529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:29.177794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:29.178398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:29.184879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:29.185355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:29.185816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.186527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:29.186974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:29.187394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.317307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:29.325669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-142edd6a-87c6-49b3-949e-626eb25aad2a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151600 Sep 13 14:34:29.326299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1812/3530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:29 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:29.419642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:29.420240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:29.426131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:29.426602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:29.427028 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.427701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:29.428149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:29.428565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:29.572429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:29.581074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:29.582565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:29.583723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0fc820e4-005b-4363-b2ae-6547370d53a0 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168024 Sep 13 14:34:29.584285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1719/3531] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:29 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:30.164867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:30.165464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:30.171930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.172399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.172827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.173496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.174039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.174457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.198904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:30.199511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:30.206310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.206788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.207222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.207921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.208356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.208778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.271641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:30.280817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec595a50-eabb-41bc-a13c-c2df93423c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086212 Sep 13 14:34:30.281387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1720/3532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:30.303580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:30.311793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0be1ae16-0fc4-42b0-95e5-b80040ac106a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150819 Sep 13 14:34:30.312353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1813/3533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:30.348419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:30.349015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:30.355269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.355738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.356162 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.356834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.357372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.357826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.375265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:30.486199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:30.494908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9212dc29-7bfe-4253-89a3-bad869306680 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150309 Sep 13 14:34:30.495469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1721/3534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:30 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:30.608807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:30.609421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:30.615300 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.615772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.616199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.616874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:30.617321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:30.618555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:30.751358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:30.760562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:30.762019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:30.763158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-525fa70f-280d-4d22-ac2a-0c1103c85be8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158312 Sep 13 14:34:30.763706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1814/3535] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:30 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:31.303879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:31.304395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:31.310840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.311310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.311737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.312409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.312852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.313274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.334956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:31.335590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:31.342792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.343277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.343713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.344402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.344889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.345313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.378368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:31.386772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f803322b-292d-43e9-ad49-0d61fc15c19d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086804 Sep 13 14:34:31.387353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1722/3536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:31.474267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:31.483291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-55245426-e77f-48f0-bb7f-5d2eec437aac tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152133 Sep 13 14:34:31.483857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1815/3537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:31.518705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:31.519310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:31.526224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.526706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.527173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.527857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.528556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.528707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.654973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:31.662977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d17d3fca-286f-4cf8-8912-23628d5abeff tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148096 Sep 13 14:34:31.663538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1723/3538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:31 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:31.788276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:31.788880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:31.790974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:31.796376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.796854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.797281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.797986 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:31.798434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:31.798851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:31.933564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:31.942168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:31.943597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:31.944740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d9b411e-5a17-401b-a2ea-b405b0d4a7c9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.160365 Sep 13 14:34:31.945295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1816/3539] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:31 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:32.410491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:32.411092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:32.418048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.418517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.418940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.419613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.420054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.420468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.480793 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:32.488963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-de479811-2b8d-4b3b-aa7b-e9dbdb409bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082342 Sep 13 14:34:32.489533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1724/3540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:32.505990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:32.506597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:32.513040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.513509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.513973 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.514644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.515091 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.515506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.643118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:32.652155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4f93e12a-27e6-4ea8-8f37-740ce386c828 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149935 Sep 13 14:34:32.652713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1817/3541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:32 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:32.686613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:32.687150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:32.693008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.693477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.693942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.694620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.695061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.695474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.825915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:32.833933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f85fec28-cab3-4d20-8c32-86a89280473f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151111 Sep 13 14:34:32.834493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1725/3542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:32 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:32.970152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:32.970755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:32.976567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.977848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.978285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:32.978961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:32.979440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:32.979860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:33.105361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:33.113957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:33.115387 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:33.116529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7eeebf1f-e969-4245-aa85-0d207880fe05 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.150218 Sep 13 14:34:33.117088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1818/3543] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:32 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:33.512857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:33.513465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:33.519898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:33.520377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:33.520816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:33.521513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:33.522253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:33.522685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:33.589242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:33.597444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-acd50948-e944-4ef7-904a-8b1beba03dc1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089197 Sep 13 14:34:33.598145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1726/3544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:33.676115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:33.676799 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:33.683494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:33.683974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:33.684409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:33.685093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:33.685544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:33.685991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:33.825273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:33.833750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca7ea4ba-2b9b-49d7-bdaf-aa2826ecec63 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.161500 Sep 13 14:34:33.834318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1819/3545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:33.858065 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:33.858667 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:33.864741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:33.865216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:33.865639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:33.866378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:33.866818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:33.867234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.144119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:34.144730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:34.151827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:34.152309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:34.152734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.153426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:34.153914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:34.154342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.284517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:34.293297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:34.294765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:34.295914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9a181b2c-2913-49de-96a1-81b957564200 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155788 Sep 13 14:34:34.296470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1820/3546] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:34 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:34.319947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:34.328878 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f936312a-0f8a-4854-970b-4adfe0ff911b tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.474629 Sep 13 14:34:34.329809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1727/3547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:33 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:34.619421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:34.620068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:34.626078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:34.626561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:34.626992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.627678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:34.628136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:34.628564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.694125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:34.702934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5d152d82-1fae-4640-bd26-19b845de161d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087396 Sep 13 14:34:34.703504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1821/3548] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:34.856880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:34.857478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:34.863930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:34.864398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:34.864820 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.865489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:34.865962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:34.866378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:34.990955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:34.999858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7eb608ee-cbc7-4c32-8043-b71af1d80a1d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.146858 Sep 13 14:34:35.000432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1728/3549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:35.323361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:35.323970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:35.329891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:35.330370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:35.330798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:35.331478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:35.331929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:35.332351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:35.352317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:35.353027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:35.358965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:35.359435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:35.359869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:35.360555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:35.361003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:35.361423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:35.462246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:35.471247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:35.472871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:35.474075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-577c4b41-1cc3-4df3-b201-25a9f33f809c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155274 Sep 13 14:34:35.474643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1822/3550] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:35 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:35.493982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:35.502130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ccd849c-7a3b-47e1-98b3-345cc1349b3e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153661 Sep 13 14:34:35.502699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1729/3551] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:35 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:35.726080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:35.726697 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:35.733677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:35.734188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:35.734618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:35.735304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:35.735756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:35.736179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:35.740209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:35.800470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:35.809634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d5abe403-9d6a-43d1-b430-0ff97660d705 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087396 Sep 13 14:34:35.810444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1823/3552] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:36.025157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:36.025789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:36.032330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.032840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.033272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.033994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.034449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.034868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.161634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:34:36.162000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:34:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed (ip 10.222.0.20) !!! Sep 13 14:34:36.166867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:36.175661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f864e1dc-2fc5-4969-876c-ce0e3773c523 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155281 Sep 13 14:34:36.176207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1730/3553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:36.500403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:36.501010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:36.506926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.507397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.507823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.509190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.509641 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.510156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.525825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:36.526445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:36.533855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.534337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.534768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.535459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.535908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.536327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.653685 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:36.662253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:36.663720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:36.665067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2de4fe80-a552-46ff-ae2f-e673152e5645 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.168592 Sep 13 14:34:36.665626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1824/3554] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:36 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:36.671261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:36.679519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8e54e6c4-b337-48be-b019-b64521346283 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157808 Sep 13 14:34:36.680584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1731/3555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:36 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:36.832377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:36.832920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:36.839539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.840023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.840500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.841185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:36.841644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:36.842104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:36.903808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:36.912054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e96db230-36e7-4203-ad9b-0461f66d3929 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083645 Sep 13 14:34:36.912622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1825/3556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:37.198281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:37.198890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:37.205381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.205889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.206318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.206994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.207439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.207860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.340033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:37.348397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d247e6cd-a1fc-4007-ac7d-c6fb82edf0b9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154218 Sep 13 14:34:37.349017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1732/3557] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:37.690565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:37.691204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:37.698154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.698642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.699087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.699788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.700235 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.700674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.703933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:37.704592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:37.710402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.710873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.712057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.712832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.713278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.713698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.835687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:37.840493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:37.845800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:37.847361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:37.848585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b83b3b4f-d915-4a87-a11c-0a5a6d43cce0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.148448 Sep 13 14:34:37.848691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-810f473a-3338-4c97-8ce1-703cdf3bcc68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161927 Sep 13 14:34:37.849155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1733/3558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:37 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:37.849297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1826/3559] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:37 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:37.935907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:37.936508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:37.942378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.942852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.943276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:37.943945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:37.944388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:37.944806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:38.005141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:38.013826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b33c9235-7e85-49c9-bdca-57b08b0c6afa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081624 Sep 13 14:34:38.014384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1734/3560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:38.372882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:38.373489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:38.379465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:38.379949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:38.380392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:38.381079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:38.381537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:38.381988 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:38.511874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:38.520008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f7379e08-7d74-4d28-83ee-6a1d037bde14 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151111 Sep 13 14:34:38.520581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1827/3561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:38.872131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:38.872692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:38.874056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:38.874668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:38.879430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:38.879922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:38.880395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:38.880900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:38.881094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:38.881379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:38.881549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:38.881894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:38.881996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:38.882580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:38.883701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:38.884181 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:39.015462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:39.024620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:39.025094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:39.026711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:39.027881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-774976f9-f23b-40e0-834a-7c62a7ab356c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157712 Sep 13 14:34:39.028633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1828/3562] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:38 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:39.033189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c1f1af8-f70a-44a2-a787-346cd7fc1bde tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.165523 Sep 13 14:34:39.033854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1735/3563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:38 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:39.036199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:39.036804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:39.043605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:39.044085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:39.044514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:39.045195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:39.045642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:39.046085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:39.106706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:39.114689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6c0921b3-10dc-403e-b016-116f85f26ab3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082059 Sep 13 14:34:39.115245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1829/3564] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:39.544131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:39.544738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:39.550783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:39.551260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:39.551696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:39.552379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:39.552831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:39.553256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:39.678273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:39.686413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e0320635-4111-445b-8b99-c4d9488d47f3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147119 Sep 13 14:34:39.686975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1736/3565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:39 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:40.053599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:40.054259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:40.057209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:40.057833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:40.060921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.061402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.061855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.062537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.062985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.063543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.064331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.064803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.065232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.065942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.066385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.066802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.196632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:40.199734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:40.205612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:40.207084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:40.207873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-697658f8-e004-444e-945f-319ee75c5ce2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154554 Sep 13 14:34:40.208229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c6e03443-b8f9-4933-9e6f-cf45fd9d9cb8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.158558 Sep 13 14:34:40.208444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1737/3566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:40 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:40.208938 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1830/3567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:40 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:40.212886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:40.213492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:40.215345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:40.220587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.221067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.221503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.222217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.222682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.223101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.227373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:40.284404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:40.292739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ebadde51-d3f3-47bd-964b-dd26f51e5378 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083287 Sep 13 14:34:40.293303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1738/3568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:40.708648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:40.709258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:40.715940 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.716454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.716891 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.717589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:40.718080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:40.718505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:40.846677 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:40.855327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4caf56ec-b165-4c75-b892-1e6832976b9e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150578 Sep 13 14:34:40.855898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1831/3569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:41.231728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:41.232355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:41.233544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:41.234176 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:41.238770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.239314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.239670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.240368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.240454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.240797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.240903 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.241207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.241294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.241999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.242463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.242896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.369881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:41.373933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:41.378149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3fb3137c-9d95-471c-b3ec-03332dcced24 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151039 Sep 13 14:34:41.378725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1739/3570] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:41 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:41.382504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:41.383805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:41.384440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:41.384721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:41.385588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c13c5c17-0b71-45e1-99f7-a43c0b50d975 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155862 Sep 13 14:34:41.386508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1832/3571] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:41 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:41.390771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.391262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.391725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.392600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.393062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.393516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.454593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:41.463808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d02d53f3-6dfe-450c-91fb-8bbac9ba3c43 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084112 Sep 13 14:34:41.464464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1740/3572] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:41.879217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:41.879746 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:41.886631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.887107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.887532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:41.888204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:41.888654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:41.889073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.027319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:42.035549 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1951bcca-95ff-489c-9cb1-c53c3569c743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160338 Sep 13 14:34:42.036116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1833/3573] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:42.402965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:42.403564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:42.410190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:42.410677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:42.411113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.411214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:42.411719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:42.411815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:42.412253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:42.412676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.418763 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:42.419245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:42.419678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.420364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:42.420815 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:42.421240 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.550241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:42.551889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:42.559514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:42.560107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4eecd690-e768-4024-866c-edda2fa8c921 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.161754 Sep 13 14:34:42.560679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1741/3574] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:42 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:42.560956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:42.562160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bc943048-8dea-4ad2-8f42-586a7cf0d66b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154865 Sep 13 14:34:42.562859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1834/3575] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:42 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:42.565008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:42.565603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:42.571335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:42.571921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:42.572353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.573033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:42.573483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:42.573943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:42.634589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:42.642602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-977cefeb-9cd3-42ac-9b29-a73d82aee1c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081000 Sep 13 14:34:42.643160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1742/3576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:43.059840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:43.060449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:43.066544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.067020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.067485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.068165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.068620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.069039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.199733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:43.207922 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3a84a461-1289-484f-ab67-ed1fa0e2561f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152010 Sep 13 14:34:43.208487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1835/3577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:43.584270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:43.584873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:43.586942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:43.587547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:43.591497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.591987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.592398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.593080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.593537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.593822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.593972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.594304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.594735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.595420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.595872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.596292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.725069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:43.729123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:43.734606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:43.736087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:43.737239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-999ced94-561c-479e-8a86-49aa6cf88611 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154233 Sep 13 14:34:43.737473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1d7015bc-9388-4dc2-b9a4-2ef72567897d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157113 Sep 13 14:34:43.737893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1836/3578] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:43 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:43.753540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1743/3579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:43 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:43.753720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:43.753720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:43.753720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.753720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.754032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.754032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:43.754032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:43.754032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:43.814987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:43.823179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0519f6a7-07f8-4ace-96fe-46bba6811948 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084365 Sep 13 14:34:43.823754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1837/3580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:44.231840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:44.232470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:44.238654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.239133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.239592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.240276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.240726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.241153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.366530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:44.374728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3407f3b5-8ebb-4889-85d6-147e131a1242 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.146709 Sep 13 14:34:44.375289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1744/3581] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:44.762552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:44.763686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:44.764107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:44.764759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:44.770985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.771169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.771462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.771564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.771888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.772242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.772816 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.772904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.773263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.773350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.773680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.773794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.914314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:44.923159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:44.924585 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:44.925742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef789c92-be0d-4247-bfc3-46048d92f4e9 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.165530 Sep 13 14:34:44.926320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1745/3582] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:44 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:44.931840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:44.932095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:44.935096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:44.937887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.938522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.938961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.939626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:44.940079 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:44.940482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:44.943406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0b8dc12e-c02a-452f-a572-66be8b2516e0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.186921 Sep 13 14:34:44.943974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1838/3583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:44 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:45.005335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:45.014166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7bcb839a-6031-44fd-8cd2-6dc4f5ea6965 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086772 Sep 13 14:34:45.014732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1746/3584] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:45.398015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:45.399252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:45.405406 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:45.405919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:45.406356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:45.407063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:45.407534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:45.407941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:45.534865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:45.538231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:45.543959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e0653fad-c934-493f-a13c-d99afd5dd6b6 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150138 Sep 13 14:34:45.544517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1839/3585] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:45 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:45.951753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:45.952355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:45.958730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:45.959194 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:45.959614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:45.960282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:45.960723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:45.961137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:45.968559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:45.969185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:45.975150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:45.975629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:45.976070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:45.976747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:45.977195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:45.978371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:46.091685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:46.100533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:46.101675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:46.103468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-281fb214-05d2-4ca1-ba00-57a3cf4008fb tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.155486 Sep 13 14:34:46.106274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1747/3586] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:45 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:46.116860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:46.119319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:46.120750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:46.131569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:46.131770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-33878f4d-0964-46fc-986d-62742d7da4c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.167323 Sep 13 14:34:46.145754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:46.145893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1840/3587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:45 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:46.146026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:46.146026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:46.146026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:46.146026 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:46.200501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:46.208739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2330f255-b65e-4fb9-9008-88d977cab7d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.103440 Sep 13 14:34:46.209245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1748/3588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:46.567520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:46.568129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:46.574264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:46.574754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:46.575191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:46.575878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:46.576343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:46.576770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:46.705037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:46.713269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e4e788b-4723-4b48-a9bd-587768b120ef tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149637 Sep 13 14:34:46.713852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1841/3589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:47.148407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:47.149007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:47.156081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.156237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:47.156624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.156793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:47.156974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.157665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.158146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.158599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.163027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.163501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.163933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.164610 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.165705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.166307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.299003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:47.302228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:47.307504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec761f59-a28b-4444-8a2b-d3e4d9597b79 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155155 Sep 13 14:34:47.308129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1842/3590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:47 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:47.311240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:47.312590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:47.312723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:47.313186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:47.313832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e91ab0e3-dedc-468f-87e8-09fadc6161e7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.169586 Sep 13 14:34:47.314538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1749/3591] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:47 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:47.318905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.319395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.319805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.320480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.320927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.321924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.383432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:47.391851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ed8eea9-76f7-410f-bb3a-3dd5224346c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082865 Sep 13 14:34:47.392411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1843/3592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:47.736697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:47.737221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:47.743734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.744207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.744714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.745387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:47.745867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:47.746310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:47.871089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:47.879179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0eca47c1-e2fb-492b-a274-afdbb691edfb tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.146334 Sep 13 14:34:47.879754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1750/3593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:48.331380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:48.331999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:48.338907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.339048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:48.339448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.339646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:48.339820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.340520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.340977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.341410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.345998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.346479 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.346918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.347601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.348051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.348468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.471580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:48.478476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:48.480895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0723618f-47b1-49db-a4cc-94e4f21d3d42 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153353 Sep 13 14:34:48.481761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1844/3594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:48 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:48.485883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:48.486483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:48.487235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:48.488663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:48.489829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-18a4ec4c-c794-4782-81e9-6c253979f5cf tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154744 Sep 13 14:34:48.490559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1751/3595] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:48 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:48.492248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.492733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.493313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.494051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.494510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.494934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.563522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:48.571872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c7ad1d14-44ad-48f0-8ac4-ea36daf381a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089393 Sep 13 14:34:48.572427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1845/3596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:48.904224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:48.904824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:48.910796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.911293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.911741 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:48.912398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:48.912842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:48.913256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.042240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:49.050281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a70b224-b4aa-4287-b780-480d852bca37 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150817 Sep 13 14:34:49.050833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1752/3597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:49.504451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:49.505050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:49.512129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:49.512604 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:49.513047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.513719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:49.514184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:49.514601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.514701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:49.515291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:49.521863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:49.522600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:49.523038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.523721 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:49.524170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:49.524620 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.645380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:49.653460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:49.653873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0ce785b2-cd8d-47af-b922-6c57a2f0c6fc tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.153239 Sep 13 14:34:49.654451 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1846/3598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:49 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:49.658797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:49.659400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:49.662480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:49.663916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:49.664998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:49.665817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6aa8dfd-7876-45c6-b237-5e7c8f05756d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154386 Sep 13 14:34:49.666154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:49.666666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1753/3599] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:49 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:49.667385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.668149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:49.668682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:49.669171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:49.730329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:49.738289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6462be86-3809-4e00-860d-3ff96ea8453f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082921 Sep 13 14:34:49.738842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1847/3600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:50.073914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:50.074521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:50.080718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.081195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.081628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.082349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.082799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.083221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.210604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:50.214434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:50.220177 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b949bcf4-85dc-42a8-9723-3137583e3993 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150379 Sep 13 14:34:50.220748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1754/3601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:50.677620 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:50.678264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:50.685316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.685834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.686280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.686966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.687418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.687839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.691274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:50.691876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:50.698828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.699303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.699765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.700451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.700896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.701314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.822993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:50.831315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ece3b01c-ceb4-41ca-a01b-acd5c377e5b7 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.157595 Sep 13 14:34:50.831893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1848/3602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:50 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:50.832128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:50.836277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:50.836892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:50.841974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:50.842897 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.843385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.843490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:50.843821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.844507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:50.844619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9af999f8-141c-4283-ba0b-f76d12823c68 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.157415 Sep 13 14:34:50.844961 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:50.845380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:50.851049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1755/3603] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:50 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:50.906114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:50.914152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-66fd77eb-f984-4028-a13a-4e221da8b0f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081295 Sep 13 14:34:50.914707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1849/3604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:51.243648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:51.244247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:51.250213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:51.250685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:51.251116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:51.251789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:51.252231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:51.252647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:51.381514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:51.390346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f3de5659-451d-45aa-ad3a-b194ca9cd9ce tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150529 Sep 13 14:34:51.390905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1756/3605] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:51 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:51.855839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:51.856380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:51.862856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:51.864509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:51.864509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:51.864509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:51.864884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:51.865288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:51.870180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:51.870785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:51.876834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:51.877302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:51.877722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:51.878420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:51.878861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:51.879273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:51.994542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:52.002934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-98e4536e-7d9d-4120-8bb3-55a53b4e13aa tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151518 Sep 13 14:34:52.003542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1850/3606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:51 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:52.007923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:52.008121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:52.008783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:52.014971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:52.015461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:52.015893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:52.016584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:52.017073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:52.017495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:52.017634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:52.019132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:52.020288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-958fe503-d6c3-421e-aee8-9f10400d6f65 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.154725 Sep 13 14:34:52.020881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1757/3607] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:51 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:52.083086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:52.092502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9fa316aa-6e20-435d-93ee-9bbf556b983b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087991 Sep 13 14:34:52.093060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1851/3608] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:52.413277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:52.413915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:52.420445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:52.420922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:52.421355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:52.422057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:52.422509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:52.422927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:52.556415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:52.564892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca954a2c-5f65-4a85-a779-06904d5b2b92 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155381 Sep 13 14:34:52.565460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1758/3609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:52 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:53.027351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:53.027992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:53.034473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.034951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.035385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.036071 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.036523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.036977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.045543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:53.046372 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 7b2c4488-4c00-4d44-ae73-a78e48c07a1b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:53.052644 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.053115 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.053541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.054249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.054699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.055120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.175913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:53.184896 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-00325676-10c4-40a6-886e-5f5ab55844e1 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.161788 Sep 13 14:34:53.185462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1852/3610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:53 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:53.189899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:53.190504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:53.190871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:53.197205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.197721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.198218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.198905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.199362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.199786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.200678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:53.202143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:53.203283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57159ca7-d351-438f-889e-b89d21b81147 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b" status: 200 len: 1801 microversion: 2.20 time: 0.161599 Sep 13 14:34:53.203839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1759/3611] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:53 2022] GET /compute/v2.1/servers/7b2c4488-4c00-4d44-ae73-a78e48c07a1b => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:53.229546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d429b931-e2e9-4b8e-b0a7-19e4298d0e72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '.version_select at 0x7fc9d43dd430>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:53.253525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d429b931-e2e9-4b8e-b0a7-19e4298d0e72 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-532385695" status: 204 len: 0 microversion: 2.20 time: 0.028179 Sep 13 14:34:53.254135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1760/3612] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Sep 13 14:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-532385695 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 14:34:53.265585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:53.274052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1c464924-acce-4c57-ad60-4aa33ca55fa4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087575 Sep 13 14:34:53.274603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1853/3613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:53.589235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:53.590009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:53.596200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.596751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.597282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.597999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:53.598458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:53.598881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:53.788715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:53.797538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-346bf5af-8b53-47f9-8ecc-9952baf18f19 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.212883 Sep 13 14:34:53.798179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1761/3614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:53 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:54.185479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-a9f2fbd3-389d-4144-bc5c-7657f4312268 req-62cbf8fb-6efd-4a5f-88e9-16c23e8c230c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:34:54.195323 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a9f2fbd3-389d-4144-bc5c-7657f4312268 req-62cbf8fb-6efd-4a5f-88e9-16c23e8c230c service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.195827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a9f2fbd3-389d-4144-bc5c-7657f4312268 req-62cbf8fb-6efd-4a5f-88e9-16c23e8c230c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.196776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a9f2fbd3-389d-4144-bc5c-7657f4312268 req-62cbf8fb-6efd-4a5f-88e9-16c23e8c230c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:54.211681 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:54.213120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:54.216863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-a9f2fbd3-389d-4144-bc5c-7657f4312268 req-62cbf8fb-6efd-4a5f-88e9-16c23e8c230c service nova] Creating event network-changed:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:34:54.222752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-a9f2fbd3-389d-4144-bc5c-7657f4312268 req-62cbf8fb-6efd-4a5f-88e9-16c23e8c230c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042549 Sep 13 14:34:54.224013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1854/3615] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:34:54.226204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.226658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.227278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:54.228424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.229154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.229828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:54.297560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:54.298203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:54.307416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.307907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.308335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:54.309024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.309476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.309928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:54.399405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:54.408979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e46f891d-95e6-4aff-8436-9b7f0ca0b950 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.115760 Sep 13 14:34:54.410326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1855/3616] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:54.428712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1cbc34be-0391-425e-be5b-072516fee73f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'create', calling method: .version_select at 0x7fc9d40a5d30>, body: {"keypair": {"name": "tempest-keypair-1504762495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZ5uLneqYJ8JXKS9BMloHzroke8+S6NPrrsAzYAwh7Z6xW9mp0mWRYpWji6ue4fn9GA5PQDTJuU2KWGwjOqXQ9OqJB5tn+9WYEVVGdX2hepfv7Ar/Cw+erR9pKZtDiXag=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:34:54.441920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:54.449085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-1cbc34be-0391-425e-be5b-072516fee73f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for project e206bc45915744e29dcb918218fa3416. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:34:54.451454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3a091302-df8a-4602-9f6f-717b15680465 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.245251 Sep 13 14:34:54.452054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1762/3617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:54 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:54.455829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-1cbc34be-0391-425e-be5b-072516fee73f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for user 92c30fba107b4dfbb7b7b1582cee2ae8 and project e206bc45915744e29dcb918218fa3416. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:34:54.487743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1cbc34be-0391-425e-be5b-072516fee73f tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.062834 Sep 13 14:34:54.488548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1856/3618] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Sep 13 14:34:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 14:34:54.822273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:54.823108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:54.829661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.830397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.831019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:54.831729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:54.832174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:54.832597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:55.061846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:55.072580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1aaa8d1-0930-42a9-8743-4720fe0cbbdc tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.254450 Sep 13 14:34:55.073183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1763/3619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:54 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:55.439863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:55.440479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:55.447808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:55.448304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:55.448840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:55.449854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:55.450635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:55.451238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:55.476130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:55.477752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:55.485149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:55.485639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:55.486314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:55.487057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:55.487513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:55.488597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:55.552827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:55.566298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-09b76963-d6ec-47e7-8a3e-e919f6ebdac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.130207 Sep 13 14:34:55.566893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1857/3620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:55.649033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:55.658505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28b2aac7-0233-48bd-afa4-0bbe2083cf11 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.186398 Sep 13 14:34:55.659091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1764/3621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:55 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:55.963686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1495146931", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd22de2d-248b-4379-b54f-b96ce438f36c"}], "security_groups": [{"name": "tempest-securitygroup--938339892"}], "key_name": "tempest-keypair-1504762495", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:34:56.071478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] validate_networks() for [('fd22de2d-248b-4379-b54f-b96ce438f36c', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:34:56.096887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:56.097528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:56.104371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.104857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.105290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.106007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.106461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.106881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.263282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:56.272235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ae04eb8-9732-47ca-a06b-a144d659f282 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.178819 Sep 13 14:34:56.272827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1765/3622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:56 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:56.593182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:56.593897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:56.601333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.601908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.602634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.603360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.603847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.604272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.666630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:56.674803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b811f5a3-7c52-4219-9727-e3858c996d65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085448 Sep 13 14:34:56.675370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1766/3623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:56.682861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:56.683461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:56.689268 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.689766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.691056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.691759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.692214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.692640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.738382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:34:56.738883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:34:56.739266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:34:56.739672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:34:56.740105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:34:56.749570 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.750085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.750518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.751238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:56.751687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:56.752112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:56.759579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:56.765315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:34:56.772648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for project e206bc45915744e29dcb918218fa3416. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:34:56.777210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Getting quotas for user 92c30fba107b4dfbb7b7b1582cee2ae8 and project e206bc45915744e29dcb918218fa3416. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:34:56.788285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:34:56.790888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:34:56.824337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:56.832948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b300d5c7-d92e-46c9-9f70-967a42e64de5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154344 Sep 13 14:34:56.833524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1767/3624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:56 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:34:56.851894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c9ae7214-28b5-4e0f-8d2e-775ffd36bf07 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.894289 Sep 13 14:34:56.852635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1858/3625] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Sep 13 14:34:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 14:34:56.863523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f37d39e-4b21-447d-ab4f-3a27a8363d78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:56.864123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f37d39e-4b21-447d-ab4f-3a27a8363d78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:56.920388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f37d39e-4b21-447d-ab4f-3a27a8363d78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:56.927786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f37d39e-4b21-447d-ab4f-3a27a8363d78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:56.929230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f37d39e-4b21-447d-ab4f-3a27a8363d78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:56.930351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f37d39e-4b21-447d-ab4f-3a27a8363d78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1282 microversion: 2.20 time: 0.070652 Sep 13 14:34:56.931438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1768/3626] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:56 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:57.297146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:57.306273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:57.312671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.313158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.313595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.314325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.314784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.315209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.452358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:57.460764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c8e421d6-94e2-41c4-a077-9bbd6585662f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.167606 Sep 13 14:34:57.461417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1859/3627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:57 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:57.698675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:57.699374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:57.706484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.706973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.707411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.708106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.708560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.708986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.771347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:57.780997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ac99cae-76d2-4402-8526-cba1e72759ac tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086220 Sep 13 14:34:57.781526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1769/3628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:57.857287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:57.857939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:57.863860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.864341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.864772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.865454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.865937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.866363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.955786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:57.956493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:57.963013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.963484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.963907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.964589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:57.965032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:57.965444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:57.995383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:58.003696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53987996-c75e-40c2-9e1f-0a94268c487f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150263 Sep 13 14:34:58.004255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1860/3629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:57 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:58.026483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:58.034554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:58.035930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:58.037009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f0810a38-d033-4f8f-b862-b027541e0178 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1334 microversion: 2.20 time: 0.085092 Sep 13 14:34:58.037551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1770/3630] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:57 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:34:58.484734 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:58.485665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:58.493785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:58.494320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:58.494795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:58.495537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:58.495993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:58.496416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:58.632026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:58.640517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-91618cb8-1534-40be-aca2-fbe5c9b43396 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.159745 Sep 13 14:34:58.641093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1861/3631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:58 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:58.803907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:58.804508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:58.811635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:58.812302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:58.812736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:58.813420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:58.813896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:58.814314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:58.888196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:58.896732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-45e683d2-75ed-4baf-a832-14f2bc9fbf10 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.096519 Sep 13 14:34:58.897659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1771/3632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:59.027741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:59.028356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:59.034793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.036862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.037169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.037834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.038291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.038710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.063253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:59.064570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:59.071315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.072053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.079247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.080048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.080528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.081013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.187088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:59.195501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b5c12f0e-ef80-4fc3-a604-f9f6b61720ac tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.172128 Sep 13 14:34:59.196084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1862/3633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:59 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:59.345938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:59.354223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:59.355649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:59.356739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-efde4034-2f47-4b13-9ea5-9bc4580fac4e tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.298773 Sep 13 14:34:59.357293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1772/3634] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:34:59 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:34:59.663338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:59.663953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:59.670348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.670829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.671263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.671951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.672401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.672821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.737221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-e093b850-4773-4dfc-a778-cdede53284b4 req-1ae2f406-1256-42ff-b9f2-54eb5e8d40f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272293dc-7bef-48b2-bb35-c76bb953d36b", "tag": "3cc8be41-d0fc-48ec-8245-d169448e7b4f"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:34:59.748509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e093b850-4773-4dfc-a778-cdede53284b4 req-1ae2f406-1256-42ff-b9f2-54eb5e8d40f6 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.748994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e093b850-4773-4dfc-a778-cdede53284b4 req-1ae2f406-1256-42ff-b9f2-54eb5e8d40f6 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.749425 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-e093b850-4773-4dfc-a778-cdede53284b4 req-1ae2f406-1256-42ff-b9f2-54eb5e8d40f6 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.762073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-e093b850-4773-4dfc-a778-cdede53284b4 req-1ae2f406-1256-42ff-b9f2-54eb5e8d40f6 service nova] Creating event network-changed:3cc8be41-d0fc-48ec-8245-d169448e7b4f for instance 272293dc-7bef-48b2-bb35-c76bb953d36b on hv-cinder-85743 Sep 13 14:34:59.767245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-e093b850-4773-4dfc-a778-cdede53284b4 req-1ae2f406-1256-42ff-b9f2-54eb5e8d40f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Sep 13 14:34:59.767962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1773/3635] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:34:59.839872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:34:59.848152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6951c65f-038f-4b2a-9829-e2f722881621 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.188837 Sep 13 14:34:59.848816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1863/3636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:59 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:34:59.923034 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:34:59.923776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:34:59.929835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.930346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.931007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.931827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:34:59.932290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:34:59.932717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:34:59.936825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:00.218984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:00.219659 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:00.225572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:00.226289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:00.226894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:00.227665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:00.228095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:00.228512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:00.246553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:00.255196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-608816f4-e9ec-4ca5-b2db-3878c87481b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.337684 Sep 13 14:35:00.255769 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1774/3637] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:34:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:00.377367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:00.381476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:00.382197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:00.386851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0548c030-ba61-4653-8b54-de7bfa1c3102 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.171625 Sep 13 14:35:00.399295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1864/3638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:00 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:00.399451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:00.399451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:00.399451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:00.399451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:00.399740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:00.399740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:00.550544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:00.559759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:00.561248 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:00.562388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78f108b6-ac4b-45fb-a9e6-96940085fdae tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.184740 Sep 13 14:35:00.562943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1775/3639] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:00 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:35:00.873294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:00.873839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:00.879908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:00.880382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:00.880806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:00.881479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:00.881953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:00.882372 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.007860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:01.016020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-387d2abe-669f-456f-aa56-2c43b64ee9b4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.146749 Sep 13 14:35:01.016591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1865/3640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:00 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:01.278750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:01.279357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:01.285819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:01.286297 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:01.286729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.287411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:01.287862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:01.288284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.351587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:01.360382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-607282a0-5d68-448f-a62a-5f2608059184 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085427 Sep 13 14:35:01.360950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1776/3641] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:01.411555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:01.412159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:01.418623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:01.419097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:01.419530 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.420203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:01.420647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:01.421069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.550708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:01.559263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-49b92aea-6128-4c84-9c71-37f93c02cdf3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.151487 Sep 13 14:35:01.559827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1866/3642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:01 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:01.588416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:01.589012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:01.594942 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:01.595413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:01.595839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.596517 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:01.596960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:01.597397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:01.721664 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:01.729996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:01.731435 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:01.732538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec659711-de48-4730-bf60-39498e57de8b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.148896 Sep 13 14:35:01.733091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1777/3643] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:01 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:02.038445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:02.039049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:02.045924 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.046401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.046828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.047510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.047956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.048427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.175780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:02.184658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9986485d-70bd-4202-b812-13ce0c0202e1 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149978 Sep 13 14:35:02.185230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1867/3644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:02 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:02.383259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:02.383954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:02.390485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.390962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.391392 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.392074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.392524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.392944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.457753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:02.466125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fe340716-017d-4076-a454-6dca02d8bc11 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086738 Sep 13 14:35:02.466699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1778/3645] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:02.583861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:02.584605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:02.590789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.591271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.591708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.592395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.592853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.593282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.721866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:02.730693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d9b8e66f-e8b6-465e-ad0f-8456d52020c4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.150892 Sep 13 14:35:02.731262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1868/3646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:02 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:02.756175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:02.756807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:02.762877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.763350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.763774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.764447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:02.764890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:02.765302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:02.889801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:02.898189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:02.900403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:02.901501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1ba15cf4-d729-481a-a531-95e520f2ea0a tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.149154 Sep 13 14:35:02.902090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1779/3647] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:02 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:03.208099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:03.208708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:03.215858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.216339 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.216771 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.217449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.217930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.218353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.343813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:03.351999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-45de7082-aac9-436a-b645-7c5032e087ec tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147731 Sep 13 14:35:03.352612 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1869/3648] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:03 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:03.488908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:03.489506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:03.496538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.497006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.497430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.498138 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.498584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.499001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.559936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:03.569119 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2f17a878-2189-41aa-9dd8-3f096a3d5de5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083951 Sep 13 14:35:03.569778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1780/3649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:03.756786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:03.757558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:03.764125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.764606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.765038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.765755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.766198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.766619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.897825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:03.906124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c4c56f9c-2b7b-4878-af27-c3f7007413f3 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.155640 Sep 13 14:35:03.906686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1870/3650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:03 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:03.926467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:03.927075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:03.934132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.934616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.935053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:03.935742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:03.936197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:03.936621 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:04.066525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:04.074548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:04.075978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:04.077095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f715d399-d17f-469b-b824-0809e0ad04e3 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.154472 Sep 13 14:35:04.077645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1781/3651] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:03 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:04.374373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:04.374908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:04.381328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:04.381848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:04.382287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:04.382969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:04.383424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:04.383849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:04.510358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:04.518516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-764a8f5a-6a2f-4560-8ad7-5c4b4e1b8118 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148049 Sep 13 14:35:04.519089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1871/3652] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:04 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:04.593218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:04.593850 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:04.600364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:04.600843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:04.601272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:04.601985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:04.602564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:04.602997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:04.665668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:04.674148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ee2cb717-3ec1-4062-8d5e-f10904c814be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084798 Sep 13 14:35:04.674727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1782/3653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:04.930707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:04.931206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:04.937155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:04.937631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:04.938086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:04.938761 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:04.939207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:04.939622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.064982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:05.073800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6a3ed4ad-887a-4e1d-972a-270e11058088 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.147540 Sep 13 14:35:05.074355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1872/3654] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:04 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:05.100893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:05.101494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:05.107469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.107944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.108371 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.109047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.109510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.109950 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.238647 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:05.247458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:05.249059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:05.250209 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da4a5083-9ef8-48c6-b313-c4536c35e362 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.153195 Sep 13 14:35:05.250766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1783/3655] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:05 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:05.543527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:05.544136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:05.550648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.551135 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.551567 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.552519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.552976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.553398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.690700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:05.697697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:05.699053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:05.699776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d8c81d9c-6b6f-4b44-8c45-2dbe70aa801b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.160589 Sep 13 14:35:05.706042 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.706607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.707125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.708018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.708736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.709711 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.713912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1873/3656] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:05 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:05.780679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:05.789870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e8d04ca3-97bc-4548-bd17-c6f4e2210ba7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.096011 Sep 13 14:35:05.790587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1784/3657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:05.813701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-4dd0fce5-a751-47aa-823f-04eea1c4a545 req-272618e8-0c6f-49c0-8ce4-5fb75f6cf982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272293dc-7bef-48b2-bb35-c76bb953d36b", "name": "network-vif-plugged", "status": "completed", "tag": "3cc8be41-d0fc-48ec-8245-d169448e7b4f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:05.823310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4dd0fce5-a751-47aa-823f-04eea1c4a545 req-272618e8-0c6f-49c0-8ce4-5fb75f6cf982 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:05.823783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4dd0fce5-a751-47aa-823f-04eea1c4a545 req-272618e8-0c6f-49c0-8ce4-5fb75f6cf982 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:05.824244 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-4dd0fce5-a751-47aa-823f-04eea1c4a545 req-272618e8-0c6f-49c0-8ce4-5fb75f6cf982 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:05.834946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-4dd0fce5-a751-47aa-823f-04eea1c4a545 req-272618e8-0c6f-49c0-8ce4-5fb75f6cf982 service nova] Creating event network-vif-plugged:3cc8be41-d0fc-48ec-8245-d169448e7b4f for instance 272293dc-7bef-48b2-bb35-c76bb953d36b on hv-cinder-85743 Sep 13 14:35:05.840315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-4dd0fce5-a751-47aa-823f-04eea1c4a545 req-272618e8-0c6f-49c0-8ce4-5fb75f6cf982 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099906 Sep 13 14:35:05.840883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1874/3658] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:35:06.096935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:06.097580 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:06.103611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.104052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.104480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.105157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.105604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.106054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.231529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:06.239696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3e863a77-2a93-459c-8ad4-97a1b1718afd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.146727 Sep 13 14:35:06.240263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1785/3659] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:06 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:06.276411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:06.277093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:06.283258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.283737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.284163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.284835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.285277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.285692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.412647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:06.421231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:06.422689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:06.423770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f0412e2f-4097-4bb6-8d8b-8f22488c67f6 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.152078 Sep 13 14:35:06.424320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1875/3660] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:06 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:06.723355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:06.723960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:06.726275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:06.732322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.732797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.733226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.733933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.734381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.734798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.812581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:06.813265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:06.815805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:06.816480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=10 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:06.822027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.823011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.823441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.824123 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:06.824600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:06.825017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:06.830548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:06.865300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:06.874061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57a0b71f-f138-4262-8402-b0ed44cfd7b5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154331 Sep 13 14:35:06.874650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1786/3661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:06 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:06.890469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:06.898884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7422e800-dbf7-40b5-b73b-a1bba617903d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090272 Sep 13 14:35:06.899440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1876/3662] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:07.264485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:07.265094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:07.267008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:07.272774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.273271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.273703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.274415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.274870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.275406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.403909 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:07.412809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dbbf9d0f-cd73-4f93-ad8e-40b02cbae2bb tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152678 Sep 13 14:35:07.413443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1787/3663] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:07 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:07.449505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:07.450210 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:07.456116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.456594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.457025 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.457707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.458183 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.458632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.590800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:07.599421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:07.600887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:07.602008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9db033dd-7d1c-440b-98c8-f96ab0d058ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1407 microversion: 2.20 time: 0.157095 Sep 13 14:35:07.602552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1877/3664] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:07 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:07.898483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:07.899124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:07.906509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.906991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.907431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.908127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.908582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.909008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.923435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:07.924171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:07.930576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.931066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.931531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.932580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:07.933047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:07.933475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:07.997776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:08.006058 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-896966ef-c0cf-4a99-bf91-6c46d39eb151 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086469 Sep 13 14:35:08.006645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1878/3665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:08.042352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:08.050385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d430ea1-61c3-4734-944b-96ab6e403743 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156049 Sep 13 14:35:08.050972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1788/3666] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:07 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:08.436467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:08.436584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:08.442419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:08.442898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:08.443325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:08.444007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:08.444467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:08.444887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:08.576149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:08.584266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-856091be-9b37-4c53-af0f-2eaca79e8867 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.152213 Sep 13 14:35:08.584829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1879/3667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:08 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:08.626811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:08.627423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:08.633309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:08.633821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:08.634277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:08.635677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:08.636207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:08.636638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:08.763930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:08.772450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:08.773921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:08.775063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f19aea17-7a00-42d5-8011-f187adf3f6ea tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1599 microversion: 2.20 time: 0.152099 Sep 13 14:35:08.775629 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1789/3668] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:35:08 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:35:08.798822 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:08.799317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:08.805305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:08.805927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:08.806379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:08.807638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:08.808096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:08.808523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:08.887809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0b703500-d676-499c-b0b8-96debf1174f8 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092829 Sep 13 14:35:08.888430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1880/3669] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Sep 13 14:35:08 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:35:09.029275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:09.029978 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:09.036341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.036817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.037257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.037965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.038420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.038845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.073538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:09.074186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:09.080369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.081249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.081380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.082089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.082548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.083122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.104529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:09.108163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:09.114181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-edb94adb-073a-41aa-b728-73a1c1da27df tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089240 Sep 13 14:35:09.114761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1790/3670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:09.341356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:09.349491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-588e20a1-fae1-4f67-b049-aded856653dd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.280948 Sep 13 14:35:09.350105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1881/3671] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:09 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:09.608712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:09.609272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:09.615380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.615884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.616301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.616999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.617454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.617908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.750017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:09.758289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef027dd5-d000-4304-bb8b-f447572c10ca tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.154196 Sep 13 14:35:09.758848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1791/3672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:09 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:09.940214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-e3a273d3-7053-4cbf-b4a0-a93148eb3a51 req-86888d98-33f4-4249-830a-326ee0030d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272293dc-7bef-48b2-bb35-c76bb953d36b", "tag": "3cc8be41-d0fc-48ec-8245-d169448e7b4f"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:09.951024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e3a273d3-7053-4cbf-b4a0-a93148eb3a51 req-86888d98-33f4-4249-830a-326ee0030d67 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:09.951513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e3a273d3-7053-4cbf-b4a0-a93148eb3a51 req-86888d98-33f4-4249-830a-326ee0030d67 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:09.951993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e3a273d3-7053-4cbf-b4a0-a93148eb3a51 req-86888d98-33f4-4249-830a-326ee0030d67 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:09.967015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-e3a273d3-7053-4cbf-b4a0-a93148eb3a51 req-86888d98-33f4-4249-830a-326ee0030d67 service nova] Creating event network-changed:3cc8be41-d0fc-48ec-8245-d169448e7b4f for instance 272293dc-7bef-48b2-bb35-c76bb953d36b on hv-cinder-85743 Sep 13 14:35:09.972393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-e3a273d3-7053-4cbf-b4a0-a93148eb3a51 req-86888d98-33f4-4249-830a-326ee0030d67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094395 Sep 13 14:35:09.973005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1882/3673] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:35:10.137576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:10.138212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:10.144613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:10.145016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:10.145442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:10.146147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:10.146596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:10.147263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:10.218457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:10.226853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25cc7ceb-b4fc-49fd-991a-e19de813ffe5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.094037 Sep 13 14:35:10.227540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1792/3674] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:10.375322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:10.376017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:10.382212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:10.382693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:10.383122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:10.383810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:10.384258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:10.385443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:10.524242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:10.535718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78d290c0-237f-4d28-946c-00b5d8f6594c tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.165071 Sep 13 14:35:10.536617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1883/3675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:10 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:10.783535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:10.784150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:10.790237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:10.791244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:10.791642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:10.792333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:10.792785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:10.793238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:10.929045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:10.938021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7b28e29d-dad2-4b21-a980-43a531e947f0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1726 microversion: 2.1 time: 0.158140 Sep 13 14:35:10.938540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1793/3676] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:10 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:10.961831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b9ba2e15-457b-4155-983e-5de9bfa0def5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '.version_select at 0x7fc9d4eb6040>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:10.984051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b9ba2e15-457b-4155-983e-5de9bfa0def5 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840970379" status: 202 len: 0 microversion: 2.1 time: 0.025985 Sep 13 14:35:10.985070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1884/3677] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 13 14:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840970379 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:35:11.250742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:11.251413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:11.260574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:11.261106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:11.261575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:11.262313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:11.262766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:11.263391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:11.333292 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:11.342183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e981df0-b0f7-4ef4-9e7a-81c2dfc3ad2f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.095330 Sep 13 14:35:11.342759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1794/3678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:11.559997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:11.560985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:11.567158 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:11.567637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:11.568064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:11.568747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:11.569196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:11.569613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:12.032939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:12.042674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f47c1e4e-559a-4783-8e4b-5356b02ece3a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.487452 Sep 13 14:35:12.043246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1885/3679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:11 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:12.182493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-f8746d32-d394-4e6d-ad9a-5022ee923fe0 req-8ce2ef94-8cce-4817-86a9-9e69e71b94de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a135d16e-8e8e-4582-ac03-366876df7369", "tag": "bc5cdfa1-9e5a-4662-91f9-047e110b433b"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:12.193898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f8746d32-d394-4e6d-ad9a-5022ee923fe0 req-8ce2ef94-8cce-4817-86a9-9e69e71b94de service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:12.193898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f8746d32-d394-4e6d-ad9a-5022ee923fe0 req-8ce2ef94-8cce-4817-86a9-9e69e71b94de service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:12.193898 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f8746d32-d394-4e6d-ad9a-5022ee923fe0 req-8ce2ef94-8cce-4817-86a9-9e69e71b94de service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:12.205794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-f8746d32-d394-4e6d-ad9a-5022ee923fe0 req-8ce2ef94-8cce-4817-86a9-9e69e71b94de service nova] Creating event network-changed:bc5cdfa1-9e5a-4662-91f9-047e110b433b for instance a135d16e-8e8e-4582-ac03-366876df7369 on hv-cinder-85743 Sep 13 14:35:12.211103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-f8746d32-d394-4e6d-ad9a-5022ee923fe0 req-8ce2ef94-8cce-4817-86a9-9e69e71b94de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032485 Sep 13 14:35:12.214272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1795/3680] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:35:12.375757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:12.377401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:12.387381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:12.387805 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:12.388248 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:12.389572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:12.390558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:12.391011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:12.433624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6355e0a2-150e-4067-8189-7a1664964821 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: .version_select at 0x7fc9d7a13b80>, body: {"keypair": {"name": "tempest-keypair-272353626", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpsqrhx3qaokpiBZevfZyRKCzKwVWaXKFYjT9BGMULXvTenbBx74xkX85F40VUMKoZxxu1DQc75ogbrdzJMh0aOYRnWREC1myoV87qm958dxdDqdlU+QHmIrTZFnqylzw=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:12.464671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6355e0a2-150e-4067-8189-7a1664964821 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:35:12.469369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-6355e0a2-150e-4067-8189-7a1664964821 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:35:12.477439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:12.488898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-eef1d6b3-8492-44f1-af30-5f42155f7630 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.124946 Sep 13 14:35:12.489952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1886/3681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:12.500737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6355e0a2-150e-4067-8189-7a1664964821 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072296 Sep 13 14:35:12.502391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1796/3682] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:35:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:35:13.066113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:13.066821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:13.074393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:13.074888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:13.075325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:13.076037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:13.076499 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:13.076923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:13.221099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:13.237952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f75f06b8-9603-477e-a8e6-d0e832fc5dd4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.175490 Sep 13 14:35:13.238544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1887/3683] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:13 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:13.518774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:13.519558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:13.526962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:13.527750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:13.528355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:13.529749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:13.530231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:13.530649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:13.596289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:13.604675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2b5a2128-d95b-46bb-8beb-625e2f3aa3f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090719 Sep 13 14:35:13.605252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1797/3684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:13.862311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-449346631", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90f85b86-6272-4c59-ab80-1d663e05af5b"}], "security_groups": [{"name": "tempest-securitygroup--913179538"}], "key_name": "tempest-keypair-272353626", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:13.962212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] validate_networks() for [('90f85b86-6272-4c59-ab80-1d663e05af5b', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:35:14.262068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:14.262691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:14.269744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:14.270291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:14.270724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:14.271410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:14.271858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:14.272564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:14.335258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:35:14.335756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:35:14.336138 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:35:14.336546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:35:14.336992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:35:14.346423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:14.346932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:14.347368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:14.348086 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:14.348539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:14.348959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:14.367133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:35:14.371675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:35:14.383246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:35:14.385767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:35:14.404401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:14.412811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b639c165-3de9-4193-9b6f-8d51619ad8b8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155349 Sep 13 14:35:14.413767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1798/3685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:14 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:14.433826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d9ce64f-a098-438a-b6e4-dd1bea93d8ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.575706 Sep 13 14:35:14.434755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1888/3686] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:35:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:35:14.445802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3f145e84-9a91-4fdb-b843-5549b58e92ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:14.446523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3f145e84-9a91-4fdb-b843-5549b58e92ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:14.499955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3f145e84-9a91-4fdb-b843-5549b58e92ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:14.507139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3f145e84-9a91-4fdb-b843-5549b58e92ae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1240 microversion: 2.1 time: 0.065223 Sep 13 14:35:14.507746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1799/3687] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:14 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:14.627830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:14.628440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:14.635711 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:14.636397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:14.636837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:14.637522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:14.638008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:14.638432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:14.709471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:14.719837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b6a4972f-62fa-4b5f-b2d3-18a5f79f6b56 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.095804 Sep 13 14:35:14.720593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1889/3688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:15.436384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:15.436917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:15.443287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:15.443756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:15.444180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:15.444848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:15.445289 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:15.445701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:15.532425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:15.533720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:15.540522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:15.541066 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:15.541580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:15.542302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:15.542759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:15.543258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:15.579547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:15.588515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-646979a8-59e0-448e-9681-300c6aedde83 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155339 Sep 13 14:35:15.589107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1800/3689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:15 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:15.608857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:15.616633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56e37212-8d4b-4512-a29a-e5d748568314 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1292 microversion: 2.1 time: 0.088851 Sep 13 14:35:15.617191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1890/3690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:15 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:15.748229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:15.748837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:15.754706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:15.755208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:15.755632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:15.756317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:15.756765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:15.757180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:15.836587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:15.846293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2ad80b09-3da5-45e2-9f03-55d9c967d49e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.103045 Sep 13 14:35:15.846881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1801/3691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:16.613830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:16.615049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:16.623871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:16.624543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:16.625213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:16.625933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:16.626607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:16.627182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:16.640033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:16.640694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:16.647470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:16.647946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:16.648535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:16.649226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:16.649860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:16.650286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:16.767569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:16.776933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b584fdf-7d5f-4821-a116-f47023d62e13 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.167635 Sep 13 14:35:16.777528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1891/3692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:16 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:16.870446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:16.870966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:16.877039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:16.877523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:16.877987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:16.878681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:16.879134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:16.879559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:16.943410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:16.952195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9e28c5ac-0bb8-4ddc-957b-173862654483 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085962 Sep 13 14:35:16.952768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1892/3693] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:17.095475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:17.103117 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6982583b-9f3d-4bdb-ad56-238cd2fde034 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1365 microversion: 2.1 time: 0.467420 Sep 13 14:35:17.103687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1802/3694] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:16 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1365 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:17.438948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-b7244003-18e0-48a5-b39d-b7e515841248 req-11649fe9-a9f9-4252-bae0-93a272f63b20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417476eb-1a29-4e86-9ddb-37150d8706cd", "tag": "a4e37735-ff49-47de-b962-ed3099347eb6"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:17.449030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b7244003-18e0-48a5-b39d-b7e515841248 req-11649fe9-a9f9-4252-bae0-93a272f63b20 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:17.449488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b7244003-18e0-48a5-b39d-b7e515841248 req-11649fe9-a9f9-4252-bae0-93a272f63b20 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:17.449936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b7244003-18e0-48a5-b39d-b7e515841248 req-11649fe9-a9f9-4252-bae0-93a272f63b20 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:17.462261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-b7244003-18e0-48a5-b39d-b7e515841248 req-11649fe9-a9f9-4252-bae0-93a272f63b20 service nova] Creating event network-changed:a4e37735-ff49-47de-b962-ed3099347eb6 for instance 417476eb-1a29-4e86-9ddb-37150d8706cd on hv-cinder-85743 Sep 13 14:35:17.467062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-b7244003-18e0-48a5-b39d-b7e515841248 req-11649fe9-a9f9-4252-bae0-93a272f63b20 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031725 Sep 13 14:35:17.467656 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1893/3695] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:35:17.800365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:17.800999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:17.808187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:17.808654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:17.809085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:17.809795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:17.810245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:17.810663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:17.952324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:17.960444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8073dd5c-012a-4e03-a027-85153e145921 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.163910 Sep 13 14:35:17.961013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1803/3696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:17 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:17.977289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:17.981250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:17.983282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:17.989002 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:17.989488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:17.989951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:17.990638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:17.991087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:17.991509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:18.057964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:18.066114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1b35cf31-5fdd-478e-8b3d-686b0c7d1119 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.093451 Sep 13 14:35:18.066690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1894/3697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:18.126238 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:18.126836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:18.132656 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:18.133128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:18.133556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:18.134252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:18.134697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:18.135151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:18.263798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:18.271365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c71856be-6371-4e46-8eff-443d487b79f2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1365 microversion: 2.1 time: 0.148856 Sep 13 14:35:18.271920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1804/3698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:18 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:18.983760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:18.984373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:18.990809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:18.991292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:18.991720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:18.992413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:18.992869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:18.993288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:19.088551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:19.089267 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:19.096233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:19.096634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:19.097137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:19.097861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:19.098472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:19.099056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:19.128011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:19.136796 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-badd050b-f76d-4d8b-a5e4-9e5a265df01f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157039 Sep 13 14:35:19.137358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1895/3699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:18 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:19.215157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:19.223989 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88b4308f-c1d1-4364-ace1-d5162cc22b60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.139339 Sep 13 14:35:19.224569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1805/3700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:19.294553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:19.295172 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:19.301192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:19.301686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:19.302159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:19.302876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:19.303325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:19.303742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:19.307837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:19.434264 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:19.441911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c46e0d85-24b0-401b-8f40-119bfd3e6a3f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1365 microversion: 2.1 time: 0.151313 Sep 13 14:35:19.442482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1896/3701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:19 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:20.160445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:20.160974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:20.167654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:20.168125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:20.168550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:20.169223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:20.169675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:20.170118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:20.248169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:20.248865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:20.255739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:20.256230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:20.256710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:20.257755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:20.258329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:20.258864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:20.303060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:20.312650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d82b442e-c23f-4889-b124-d07052b404e8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.155899 Sep 13 14:35:20.313438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1806/3702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:20 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:20.330892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:20.339420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-dee0e883-1466-423e-8f3c-bd5b16307ef5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.096087 Sep 13 14:35:20.339981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1897/3703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:20.465054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:20.465661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:20.471565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:20.472039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:20.472465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:20.473144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:20.473590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:20.474066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:20.600169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:20.608409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6e4e06c5-4b7c-470c-903f-876b88d43a41 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1365 microversion: 2.1 time: 0.147179 Sep 13 14:35:20.608977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1807/3704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:20 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:21.337304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:21.337889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:21.344956 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.345440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.345912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.346601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.347059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.347483 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.361386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:21.362029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:21.368475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.368952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.369382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.370137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.370781 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.371202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.434568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:21.442963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-35d0aff6-fc89-44e6-a040-f8864af96505 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085406 Sep 13 14:35:21.443536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1808/3705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:21.478274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:21.486425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2bd73698-ec25-4615-aa93-2c6b71dca9ad tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153100 Sep 13 14:35:21.486987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1898/3706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:21 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:21.631730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:21.632337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:21.638857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.639336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.639772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.640459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.640912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.641336 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.775186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:21.783375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cc740188-dec6-41d1-9fa6-3f035762bf28 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1365 microversion: 2.1 time: 0.155411 Sep 13 14:35:21.794704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1809/3707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:21 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:21.795081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-f52ac607-b8e6-4f22-a94b-ad59fe75736d req-4a633f77-811e-420d-ab6d-873e64ef2c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417476eb-1a29-4e86-9ddb-37150d8706cd", "name": "network-vif-plugged", "status": "completed", "tag": "a4e37735-ff49-47de-b962-ed3099347eb6"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:21.795081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-f52ac607-b8e6-4f22-a94b-ad59fe75736d req-4a633f77-811e-420d-ab6d-873e64ef2c13 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:21.795081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-f52ac607-b8e6-4f22-a94b-ad59fe75736d req-4a633f77-811e-420d-ab6d-873e64ef2c13 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:21.795081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-f52ac607-b8e6-4f22-a94b-ad59fe75736d req-4a633f77-811e-420d-ab6d-873e64ef2c13 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:21.806723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-f52ac607-b8e6-4f22-a94b-ad59fe75736d req-4a633f77-811e-420d-ab6d-873e64ef2c13 service nova] Creating event network-vif-plugged:a4e37735-ff49-47de-b962-ed3099347eb6 for instance 417476eb-1a29-4e86-9ddb-37150d8706cd on hv-cinder-85743 Sep 13 14:35:21.812230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-f52ac607-b8e6-4f22-a94b-ad59fe75736d req-4a633f77-811e-420d-ab6d-873e64ef2c13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031554 Sep 13 14:35:21.812821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1899/3708] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:35:22.467310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:22.467922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:22.474502 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:22.474983 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:22.475418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:22.476105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:22.476569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:22.477092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:22.481259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:22.511156 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:22.511965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:22.518260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:22.518740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:22.519297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:22.519987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:22.520954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:22.521380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:22.546256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:22.554568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-44cdb298-3b82-4273-9367-b8778478c5bd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.091870 Sep 13 14:35:22.555146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1810/3709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:22.651204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:22.659505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0be01dbd-7428-4ba4-9a50-8460cd2aa91a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153678 Sep 13 14:35:22.660057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1900/3710] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:22 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:22.806814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:22.807928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:22.814063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:22.814535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:22.814964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:22.815641 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:22.816089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:22.816556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:22.948256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:22.955990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2bc02694-0154-421f-b9dc-3b1f20c0cad2 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1365 microversion: 2.1 time: 0.153106 Sep 13 14:35:22.956563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1811/3711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:22 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:23.578806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:23.579420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:23.585836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:23.586321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:23.586759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:23.587446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:23.587902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:23.589023 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:23.654463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:23.662592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ee4ed286-70be-4383-bf33-92408ad6026e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087792 Sep 13 14:35:23.663148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1901/3712] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:23.682865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:23.683478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:23.689509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:23.690019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:23.690450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:23.691128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:23.691575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:23.691996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:23.821118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:23.830001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-568cbbb8-9d59-4db5-a8a8-d87875a0e858 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151087 Sep 13 14:35:23.830616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1812/3713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:23 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:23.978349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:23.979599 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:23.985461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:23.986075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:23.986512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:23.987187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:23.987635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:23.988059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:24.113519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:24.121171 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f5f73f5f-755f-4c78-bcc1-8e27bd4ce35a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1555 microversion: 2.1 time: 0.146688 Sep 13 14:35:24.121747 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1902/3714] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:23 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:24.143123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:24.143615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:24.149795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:24.150263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:24.150685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:24.151869 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:24.152306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:24.152720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:24.226684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ccd133e1-aaad-4665-9a45-4c29126aed34 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087374 Sep 13 14:35:24.227269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1813/3715] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:35:24 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:35:24.685987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:24.686526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:24.688459 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:24.689104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:24.696113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:24.696629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:24.697060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:24.698779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:24.699303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:24.699915 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:24.763792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:24.772304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-07fe2720-3b12-4d59-842a-70775230cbde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090116 Sep 13 14:35:24.772870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1903/3716] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:24.850746 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:24.855938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:24.856587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:24.862905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:24.863380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:24.863813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:24.864494 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:24.864947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:24.865370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:25.080605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:25.088981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3ffd4dc-2f69-4f62-b9ef-a7d24aa2af9d tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.238977 Sep 13 14:35:25.089554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1814/3717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:24 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:25.217362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-b6d4205d-efca-4f4c-a9c1-2de7010c6199 req-bd019800-6e84-44f5-8553-93e45201d68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417476eb-1a29-4e86-9ddb-37150d8706cd", "tag": "a4e37735-ff49-47de-b962-ed3099347eb6"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:35:25.226997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b6d4205d-efca-4f4c-a9c1-2de7010c6199 req-bd019800-6e84-44f5-8553-93e45201d68d service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:25.227466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b6d4205d-efca-4f4c-a9c1-2de7010c6199 req-bd019800-6e84-44f5-8553-93e45201d68d service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:25.227889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-b6d4205d-efca-4f4c-a9c1-2de7010c6199 req-bd019800-6e84-44f5-8553-93e45201d68d service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:25.239294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-b6d4205d-efca-4f4c-a9c1-2de7010c6199 req-bd019800-6e84-44f5-8553-93e45201d68d service nova] Creating event network-changed:a4e37735-ff49-47de-b962-ed3099347eb6 for instance 417476eb-1a29-4e86-9ddb-37150d8706cd on hv-cinder-85743 Sep 13 14:35:25.244143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-b6d4205d-efca-4f4c-a9c1-2de7010c6199 req-bd019800-6e84-44f5-8553-93e45201d68d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030618 Sep 13 14:35:25.248362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1904/3718] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:35:25.795315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:25.795877 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:25.801956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:25.802438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:25.802891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:25.803572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:25.804134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:25.804577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:25.871306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:25.879640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f03fecf4-2bd0-4bb5-8c22-15624d0a2bdf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088525 Sep 13 14:35:25.880241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1815/3719] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:26.113415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:26.114281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:26.121180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:26.121664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:26.122129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:26.122819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:26.123272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:26.123695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:26.257651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:26.266077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3d6ddc0d-f8bd-420e-aaa1-d6d95895a69b tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.157326 Sep 13 14:35:26.266640 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1905/3720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:26 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:26.903557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:26.904090 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:26.910564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:26.911046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:26.911478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:26.912164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:26.912619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:26.913045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:26.977912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:26.987063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f171e2ab-0ffd-4abd-9b33-91bbe1eba03e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087731 Sep 13 14:35:26.987632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1816/3721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:27.290363 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:27.290972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:27.298137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:27.298621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:27.299051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:27.299770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:27.300223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:27.300643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:27.430294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:27.438381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ccaa9fa8-ec53-4fb0-83b9-5d2fa5622c10 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151878 Sep 13 14:35:27.438941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1906/3722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:27 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:28.008782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:28.009381 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:28.016569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:28.017045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:28.017468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:28.018169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:28.018619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:28.019036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:28.079726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:28.087729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbd4f145-e623-4377-8b92-8ad92eb59004 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082780 Sep 13 14:35:28.088282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1817/3723] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:28.461784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:28.462398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:28.469466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:28.469982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:28.470416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:28.471102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:28.471557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:28.471978 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:28.605340 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:28.614031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4296472c-20ec-4a42-8852-a9ce3ae868c4 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156158 Sep 13 14:35:28.614595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1907/3724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:28 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:29.111128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:29.111767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:29.118250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:29.118725 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:29.119156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:29.119862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:29.120417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:29.120839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:29.180937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:29.189142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1f1c010c-10a7-437e-bb21-3632a0d5826f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081915 Sep 13 14:35:29.189705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1818/3725] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:29.637043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:29.637644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:29.644105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:29.644581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:29.645011 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:29.645691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:29.646173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:29.646597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:29.772521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:29.780654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c4373c7-3f3a-4ea6-8423-d780744aeec2 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147660 Sep 13 14:35:29.781164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1908/3726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:29 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:30.212142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:30.212751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:30.219587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:30.220063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:30.220490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:30.221167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:30.221612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:30.222058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:30.528089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:30.536284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6654922a-fc6b-47fc-a171-ef7273abd0a8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.327993 Sep 13 14:35:30.536854 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1819/3727] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:30.804265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:30.804809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:30.811370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:30.811883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:30.812317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:30.813010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:30.813470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:30.814094 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:30.945538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:30.959427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ff38133-598d-4d9e-910f-cd01889f980e tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.153456 Sep 13 14:35:30.959427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1909/3728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:30 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:31.560251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:31.560852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:31.567250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:31.567718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:31.568145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:31.568815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:31.569259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:31.569674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:31.631507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:31.639764 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7e4a7d5-8747-454d-bfa7-022f9680b6d3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083815 Sep 13 14:35:31.640318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1820/3729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:31.977653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:31.978331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:31.984846 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:31.985320 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:31.985772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:31.986453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:31.986904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:31.987325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:32.116017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:32.124053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6de0a325-4d93-412a-b238-350684605714 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150308 Sep 13 14:35:32.124605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1910/3730] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:31 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:32.663405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:32.664014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:32.670960 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:32.671440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:32.671872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:32.672550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:32.673002 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:32.673422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:32.733451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:32.741559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9db19b9a-2713-4859-98c1-898473a5d808 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081957 Sep 13 14:35:32.742153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1821/3731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:33.147718 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:33.148324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:33.155310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:33.155788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:33.156217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:33.156899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:33.157359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:33.157792 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:33.282977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:33.291048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7e79e7c6-d599-4cbf-b0f7-18b444b0c116 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147560 Sep 13 14:35:33.292385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1911/3732] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:33 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:33.766287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:33.766894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:33.773523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:33.774040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:33.774476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:33.775156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:33.775608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:33.776029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:33.835777 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:33.843994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-af9d5348-a5e9-48bf-8349-7463b0002b80 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081527 Sep 13 14:35:33.844559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1822/3733] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:34.315018 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:34.315661 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:34.322160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:34.322765 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:34.323204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:34.323895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:34.324350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:34.324776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:34.454574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:34.462816 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1678bd11-f36a-4aed-a102-23e9e46264e3 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151689 Sep 13 14:35:34.463958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1912/3734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:34 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:34.866263 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:34.866779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:34.877677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:34.878187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:34.878619 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:34.879304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:34.879751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:34.880187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:34.953797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:34.962069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8aaec72f-1ffb-43f6-aae7-9461a7acf526 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.099674 Sep 13 14:35:34.962636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1823/3735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:35.486957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:35.487477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:35.494068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:35.494632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:35.495056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:35.495797 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:35.496243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:35.496674 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:35.625622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:35.633869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2e53eb2b-e950-4f73-9bcc-c0f13d89e193 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150817 Sep 13 14:35:35.634436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1913/3736] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:35 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:35.986061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:35.986724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:35.993158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:35.993618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:35.994207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:35.994990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:35.995439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:35.995855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:36.058424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:36.066595 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c73244c1-266c-4ba7-81aa-b7527977aae8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084429 Sep 13 14:35:36.067164 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1824/3737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:36.657428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:36.658065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:36.664384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:36.664856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:36.665281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:36.665991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:36.666442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:36.666857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:36.670969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:36.797884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:36.806026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4bc3508a-3e76-4122-8d97-0f6242c09e51 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.152309 Sep 13 14:35:36.806574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1914/3738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:36 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:37.089038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:37.089780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:37.092081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:37.098173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:37.098691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:37.099140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:37.099846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:37.100294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:37.100709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:37.164286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:37.173973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1c33371-f926-4f19-852b-24375b1a46d0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088749 Sep 13 14:35:37.174581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1825/3739] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:37.830338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:37.830865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:37.837341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:37.837851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:37.838288 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:37.839586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:37.840081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:37.840534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:37.969892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:37.978242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f1a2bbdc-1ac9-4521-a74b-94c268073497 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151777 Sep 13 14:35:37.978810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1915/3740] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:37 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:38.197598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:38.198169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:38.205276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:38.205773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:38.206206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:38.206876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:38.207321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:38.207736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:38.270964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:38.279312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-933b715f-6c42-4e72-86ff-1c423d3658d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085575 Sep 13 14:35:38.279871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1826/3741] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:39.000550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:39.001161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:39.007573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:39.008044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:39.008467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:39.009139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:39.009587 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:39.010032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:39.136408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:39.144411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d60cd38-a01d-45fe-8287-d5f5d0f63558 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.147822 Sep 13 14:35:39.144976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1916/3742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:38 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:39.302537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:39.303055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:39.309439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:39.309952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:39.310388 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:39.311072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:39.311523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:39.311945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:39.316066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:39.375193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:39.383416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad7ff351-fe64-4e53-ba62-f8e2a8bf35b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084854 Sep 13 14:35:39.383982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1827/3743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:40.168506 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:40.169113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:40.175513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:40.175992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:40.176426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:40.177110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:40.177563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:40.178014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:40.310089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:40.318230 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1915a3a9-9108-4c4f-a0a4-88959ad3c469 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154239 Sep 13 14:35:40.318795 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1917/3744] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:40 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:40.407308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:40.407910 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:40.414331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:40.414800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:40.415224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:40.415895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:40.416341 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:40.416757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:40.478916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:40.487549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fbb2a4d5-0c8f-4f55-b68d-dc9ce26497c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084114 Sep 13 14:35:40.488111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1828/3745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:41.341764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:41.342292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:41.348615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:41.349088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:41.349517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:41.350227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:41.350679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:41.351093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:41.477538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:41.485758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-42060ba1-f020-478c-892d-2d6a1f86c48a tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.148314 Sep 13 14:35:41.486314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1918/3746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:41 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:41.510394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:41.511627 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:41.517991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:41.518460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:41.518885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:41.519565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:41.520014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:41.520434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:41.581972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:41.590127 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8a257a78-293b-45e2-b3aa-41a2abb34892 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083441 Sep 13 14:35:41.590688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1829/3747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:42.508352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:42.508957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:42.516028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:42.516501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:42.516926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:42.517601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:42.518085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:42.518504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:42.613431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:42.614154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:42.620698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:42.621269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:42.621780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:42.622529 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:42.623046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:42.623537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:42.653057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:42.661276 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5b8bd038-d69c-43bb-8550-7798abe6178f tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.156744 Sep 13 14:35:42.661860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1919/3748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:42 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:42.688067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:42.696247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-610b824b-32ac-4a6f-b4f3-946facb27b63 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086601 Sep 13 14:35:42.696801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1830/3749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:43.692608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:43.693214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:43.700738 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:43.701214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:43.701635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:43.702345 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:43.702787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:43.703203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:43.719202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:43.719799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:43.726118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:43.726589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:43.727013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:43.727714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:43.728158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:43.728572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:43.789701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:43.798729 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-614f9439-fb8e-446b-a6fe-a3e8e0034640 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083549 Sep 13 14:35:43.799299 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1831/3750] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:43.831828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:43.840758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-23191f20-1782-4ff1-956b-d48bfebe68a9 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151975 Sep 13 14:35:43.841317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1920/3751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:43 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:44.821800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:44.822344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:44.828767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:44.829246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:44.829682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:44.830389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:44.830840 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:44.831261 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:44.863861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:44.864470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:44.871690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:44.872200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:44.872634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:44.873328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:44.873804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:44.874243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:44.894150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:44.902561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3d5951db-4350-4606-831d-c4fd9a905d98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084632 Sep 13 14:35:44.903137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1832/3752] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:45.003984 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:45.012098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8458b491-99cd-4bbf-bac3-2304278f0206 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.151971 Sep 13 14:35:45.012660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1921/3753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:44 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:45.926384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:45.926935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:45.933884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:45.934368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:45.934799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:45.935483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:45.936049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:45.936652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:45.997172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:46.005301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4633492-9ad0-497f-97c8-d9a6c3112231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083171 Sep 13 14:35:46.005894 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1833/3754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:46.035189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:46.035790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:46.042945 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:46.043580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:46.044034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:46.044700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:46.045147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:46.045563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:46.095306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:46.095803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:46.101921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:46.102403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:46.102838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:46.103524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:46.103972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:46.104938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:46.131082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e9d53655-6922-40b7-b1bd-c68c0ef7a1c7 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b/ips" status: 200 len: 152 microversion: 2.20 time: 0.039607 Sep 13 14:35:46.131856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1834/3755] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Sep 13 14:35:46 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 14:35:46.181952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:46.190054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-92f88cfb-343c-4627-a998-8552b773b4c8 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.158787 Sep 13 14:35:46.190611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1922/3756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:46 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:47.028982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:47.029598 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:47.036217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:47.036695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:47.037126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:47.037836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:47.038290 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:47.038712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:47.101604 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:47.110315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88518e68-46d8-4fcc-a5e3-d2ac8bf2f887 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085582 Sep 13 14:35:47.110875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1835/3757] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:47.214512 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:47.215289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:47.221579 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:47.222082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:47.222515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:47.223189 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:47.223638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:47.224049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:47.351368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:47.360434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c71acab0-d8d0-4cc8-9768-f9b6fefb29fd tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150297 Sep 13 14:35:47.361149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1923/3758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:47 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:48.134284 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:48.134886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:48.141599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:48.142107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:48.142535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:48.143210 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:48.143657 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:48.144074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:48.205485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:48.214149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c26c5933-2819-4557-8e68-4cf539daafed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083131 Sep 13 14:35:48.214702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1836/3759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:48.383895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:48.384591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:48.387597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=60 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:48.393423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:48.393946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:48.394388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:48.395080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:48.395537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:48.395963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:48.525332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:48.534694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19a5c758-bc93-4fbd-a286-8e3f787df373 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.154646 Sep 13 14:35:48.535257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1924/3760] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:48 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:49.237923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:49.238537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:49.246282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:49.246772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:49.247256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:49.247902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:49.248361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:49.248789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:49.310352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:49.318682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dee55e48-1474-42db-a294-b40995bc1ba8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084681 Sep 13 14:35:49.319250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1837/3761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:49.558185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:49.558829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:49.565110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:49.565583 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:49.566051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:49.566731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:49.567179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:49.567593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:49.694430 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:49.703319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2e3096f8-8d3b-48cc-b4f0-a0ef6321d8a5 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.149653 Sep 13 14:35:49.703882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1925/3762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:49 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:50.342082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:50.342625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:50.349122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:50.349603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:50.350075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:50.350763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:50.351356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:50.351835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:50.414169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:50.423060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-406a852f-9e7d-48bf-9cf6-f46fe38c3b28 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085872 Sep 13 14:35:50.423622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1838/3763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:50.726482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:50.727070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] [instance: 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:50.735806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:50.736286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:50.736715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:50.737394 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:50.737888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:50.738305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:50.864297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894ea45ef5f4dcca7ced8cd7834a25a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9946e78bebe4d2a8d32a39120b0b978', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:50.873249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-54a36603-5214-42c7-8682-e6d49a472fb7 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed" status: 200 len: 1600 microversion: 2.1 time: 0.150876 Sep 13 14:35:50.873885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1926/3764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:50 2022] GET /compute/v2.1/servers/5dceb84b-c3a9-4933-b104-8c5d4cebc6ed => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:50.895233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e157267-86b8-48bb-8c55-032851081413 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] Calling method '.version_select at 0x7fc9d41de4c0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:50.913622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e157267-86b8-48bb-8c55-032851081413 tempest-TestMinimumBasicScenario-1278595442 tempest-TestMinimumBasicScenario-1278595442-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1797991648" status: 202 len: 0 microversion: 2.1 time: 0.022310 Sep 13 14:35:50.914201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1839/3765] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Sep 13 14:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1797991648 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:35:51.446222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:51.446888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:51.453879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:51.454385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:51.454821 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:51.455517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:51.455980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:51.456403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:51.523883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:51.533160 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cfc0c428-46d2-46e7-9d6b-107367e53673 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090805 Sep 13 14:35:51.533757 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1927/3766] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:52.558318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:52.559013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:52.564904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:52.565382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:52.565930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:52.566521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:52.566970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:52.567389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:52.636714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:52.644718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b299d508-decb-4c2f-bd3a-36fec05145cd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090768 Sep 13 14:35:52.645473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1840/3767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:53.668594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:53.669672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:53.677434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:53.677434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:53.677601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:53.678331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:53.678791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:53.679597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:53.744283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:53.752642 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8b6cdfd4-9e04-47b2-9e11-e0f27c55a672 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088113 Sep 13 14:35:53.753222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1928/3768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:54.776488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:54.777099 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:54.783311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:54.783787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:54.784218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:54.784896 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:54.785348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:54.785798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:54.845759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:54.853899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7929cd5d-8718-4483-bd9e-906e0837ff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081706 Sep 13 14:35:54.854789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1841/3769] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:35:55.876789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:55.877349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:55.883682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:55.884150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:55.884575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:55.885806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:55.886263 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:55.886675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:55.946919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:55.955715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-84a8a47c-4b24-403e-afaa-b5bb63c7c91a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082867 Sep 13 14:35:55.956269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1929/3770] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:56.979048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:56.979770 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:56.986678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:56.987147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:56.987578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:56.988259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:56.988704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:56.989122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:57.053395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:57.062845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-763405d3-a357-4394-b4c1-017942c599f1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087674 Sep 13 14:35:57.063402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1842/3771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:58.086233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:58.086845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:58.093650 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:58.094170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:58.094605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:58.095293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:58.095748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:58.096174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:58.157843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:58.161212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=100 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:35:58.167725 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4837bc8f-d88e-40fb-9ad1-8011bd90b50c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085261 Sep 13 14:35:58.168285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1930/3772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:35:59.191393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:35:59.192027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:35:59.199518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:59.199996 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:59.200431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:59.201112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:35:59.201560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:35:59.202062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:35:59.262351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:35:59.270353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48f00ef1-c95a-4090-84f3-8f633352b23b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082833 Sep 13 14:35:59.270920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1843/3773] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:35:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:00.293050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:00.293657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:00.300386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:00.300866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:00.301299 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:00.302004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:00.302456 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:00.302878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:00.369275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:00.378639 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3edc1ba6-bf34-4b2a-b5bb-ff7158e310d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089843 Sep 13 14:36:00.379250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1931/3774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:36:01.402783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:01.403311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:01.409806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:01.410282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:01.410708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:01.411385 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:01.411833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:01.412252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:01.476237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:01.485095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a1a84bf-3c62-4666-b046-0655d8e5eed3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087253 Sep 13 14:36:01.485650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1844/3775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:02.507704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:02.508289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:02.515378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:02.515856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:02.516287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:02.516972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:02.517425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:02.517882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:02.581364 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:02.589963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a98dbe2a-ce85-4d17-b80a-b19d85089be0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086026 Sep 13 14:36:02.590524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1932/3776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:02.944895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:02.945438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:02.952411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:02.952888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:02.953316 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:02.954011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:02.954454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:02.954867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:02.958486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=100 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:02.977662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-837c1fc0-ec44-492e-b9ea-841b144d027f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.036647 Sep 13 14:36:02.978247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1845/3777] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:36:02 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:36:03.612433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:03.613040 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:03.619444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:03.619920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:03.620347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:03.621026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:03.621476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:03.621926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:03.682475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:03.690851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7da26137-6107-4b43-84e2-f84cdc9c1fe0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082302 Sep 13 14:36:03.691409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1933/3778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:04.713180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:04.713906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:04.720156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:04.720623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:04.721048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:04.721742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:04.722193 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:04.722609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:04.783064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:04.791180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ae5b44d9-3e94-4d0e-ba59-c46d87a3c231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081891 Sep 13 14:36:04.792255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1846/3779] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:05.814434 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:05.814964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:05.821361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:05.821864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:05.822298 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:05.823668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:05.824118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:05.824538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:05.884393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:05.892901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-82d441fe-ed78-427e-b521-927f657057e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082472 Sep 13 14:36:05.893454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1934/3780] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:06.917337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:06.917921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:06.924182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:06.924659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:06.925093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:06.925802 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:06.926255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:06.926674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:06.990733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:06.998892 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-1278248e-2c69-4576-a64d-961aa4941d66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086310 Sep 13 14:36:06.999454 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1847/3781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:08.021647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:08.022532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:08.029653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:08.030275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:08.030705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:08.031378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:08.031829 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:08.032245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:08.095864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:08.104072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a14bbe75-4097-4055-ac0b-faaebb3be6e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086277 Sep 13 14:36:08.104622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1935/3782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:09.126758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:09.127364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:09.129665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:09.135583 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:09.136057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:09.136488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:09.137173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:09.137624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:09.138089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:09.347491 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:09.355698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2abd9ded-9229-43fc-81be-2aab50b91f53 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.232827 Sep 13 14:36:09.356251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1848/3783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:10.377995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:10.378598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:10.384995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:10.385469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:10.385931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:10.386616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:10.387068 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:10.387484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:10.447719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:10.455820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fb4c1178-05d8-4091-9005-1b84d6470f5a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081672 Sep 13 14:36:10.456379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1936/3784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:11.479611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:11.480246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:11.486715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:11.487192 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:11.487624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:11.488304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:11.488755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:11.489174 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:11.549967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:11.558920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d46c1c14-d698-4c77-8759-0246b733dd85 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083116 Sep 13 14:36:11.559483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1849/3785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:12.581613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:12.582252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:12.589595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:12.590100 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:12.590536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:12.591224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:12.591679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:12.592103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:12.652526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:12.660586 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e611172-c3e4-496e-bba1-00bc9b5e0efc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082831 Sep 13 14:36:12.661147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1937/3786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:13.683374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:13.684009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:13.690443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:13.690921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:13.691351 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:13.692035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:13.692484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:13.692904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:13.753398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:13.761513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-66a8dc9f-091b-4401-8b0d-3684bf8358a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082123 Sep 13 14:36:13.762106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1850/3787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:14.785039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:14.785561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:14.792786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:14.793265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:14.793702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:14.794404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:14.794857 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:14.795273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:14.859467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:14.867723 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28920466-0740-4d0c-96ef-9d963b3ded97 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086624 Sep 13 14:36:14.868279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1938/3788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:15.891640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:15.892159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:15.899014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:15.899490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:15.900058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:15.901108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:15.901593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:15.902051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:15.964499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:15.972597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-473323b7-eb6b-4d80-b720-4675390a0005 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084912 Sep 13 14:36:15.973158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1851/3789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:16.995595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:16.996192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:17.002414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:17.002892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:17.003319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:17.003997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:17.004442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:17.004860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:17.069404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:17.078369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-933b5db8-a2dd-4e1c-8404-55b23d0d3840 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086930 Sep 13 14:36:17.078935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1939/3790] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:18.102206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:18.102812 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:18.109450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:18.109973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:18.110408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:18.111086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:18.111542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:18.111961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:18.172686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:18.180757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4ab5e879-1d13-4592-8f47-33893cf1dcf7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082405 Sep 13 14:36:18.181304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1852/3791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:19.204157 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:19.204766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:19.207419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=32 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:19.212591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:19.213830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:19.214271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:19.214968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:19.215422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:19.215843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:19.277222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:19.285379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3c200614-e999-4237-b9d9-ee17992b6543 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085083 Sep 13 14:36:19.285965 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1940/3792] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:20.307949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:20.308588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:20.315111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:20.315586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:20.316021 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:20.316703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:20.317158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:20.317579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:20.377415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:20.385846 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c247f3a3-3b75-4138-97a6-a2b970022c8c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081765 Sep 13 14:36:20.386406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1853/3793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:21.410044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:21.410911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:21.417794 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:21.418275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:21.418707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:21.419391 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:21.419844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:21.420274 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:21.482196 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:21.490249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2ddc1425-c29c-4847-a5c1-7af5ff11e756 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084453 Sep 13 14:36:21.490810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1941/3794] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:22.513094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:22.513694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:22.520150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:22.520623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:22.521052 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:22.521750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:22.522467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:22.522883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:22.585826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:22.594439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e3d52f30-000d-4e85-8676-f00edba457d1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085257 Sep 13 14:36:22.594999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1854/3795] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:23.617836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:23.618445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:23.625702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:23.626213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:23.626644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:23.627431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:23.627888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:23.628311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:23.689548 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:23.698193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21131893-3588-48fa-a0be-d39d979ce67a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084203 Sep 13 14:36:23.698766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1942/3796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:24.721302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:24.721937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:24.727799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:24.728274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:24.728707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:24.729380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:24.729926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:24.730346 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:24.797693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:24.806008 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86d6a35b-044c-47af-8fe2-3faea5b974d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088612 Sep 13 14:36:24.807328 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1855/3797] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:25.829056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:25.829574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:25.835995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:25.836479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:25.836914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:25.838231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:25.838696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:25.839118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:25.902631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:25.910833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-62fd7d56-2e4d-4385-b8b2-a64050873736 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085725 Sep 13 14:36:25.911392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1943/3798] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:26.934333 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:26.934882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:26.941260 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:26.941754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:26.942200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:26.942880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:26.943332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:26.943756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:27.004762 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:27.012868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-084bba67-dcee-4156-933e-eff7e62dd02a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083235 Sep 13 14:36:27.013420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1856/3799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:28.036667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:28.037282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:28.044619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:28.045103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:28.045539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:28.046266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:28.046726 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:28.047153 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:28.108338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:28.116461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2c7a5136-3293-4c7e-83a3-d5df8afa4cde tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083740 Sep 13 14:36:28.117063 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1944/3800] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:29.140140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:29.140744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:29.147563 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:29.148039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:29.148470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:29.149150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:29.149600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:29.150690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:29.210784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:29.218941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c2739049-27ee-47dd-81df-71c231e81037 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082699 Sep 13 14:36:29.219500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1857/3801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:30.241441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:30.242083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:30.248860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:30.249336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:30.249793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:30.250478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:30.250929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:30.251348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:30.313887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:30.316102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=89 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:30.323785 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b2ae26b3-68cb-410d-92ed-7652a4fd47e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086206 Sep 13 14:36:30.324348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1945/3802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:31.347377 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:31.347913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:31.354967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:31.355427 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:31.355860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:31.356543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:31.356993 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:31.357420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:31.417862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:31.425895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4e3736eb-a04b-41dc-8b9d-33c62e354b94 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082403 Sep 13 14:36:31.426453 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1858/3803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:32.449629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:32.450295 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:32.456566 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:32.457047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:32.457482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:32.458192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:32.458647 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:32.459069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:32.520507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:32.529786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fb991a9d-9a13-4b7f-8206-07ae526fa7a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084300 Sep 13 14:36:32.530362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1946/3804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:33.553612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:33.554244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:33.561429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:33.561948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:33.562387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:33.563071 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:33.563523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:33.563946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:33.566589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=81 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:33.629257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:33.637478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-52a5ddfb-7ec3-4916-91fe-a03bf2d5e0a7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087706 Sep 13 14:36:33.638082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1859/3805] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:34.660261 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:34.660867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:34.667482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:34.667964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:34.668402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:34.669085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:34.669540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:34.669989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:34.733826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:34.741861 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b45e1c2b-8afe-4a0b-b5bd-23f679bd3ff8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085443 Sep 13 14:36:34.742413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1947/3806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:35.765242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:35.765922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:35.772839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:35.773331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:35.773786 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:35.774489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:35.775135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:35.775566 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:35.847191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:35.855927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-57123f8d-a77e-4edd-a5e1-ec21f394d553 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.094589 Sep 13 14:36:35.856498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1860/3807] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:36.879475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:36.880015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:36.886581 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:36.887061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:36.887494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:36.888175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:36.888630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:36.889053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:36.949386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:36.957435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-07130dbd-3e7d-4ed9-88cf-18fa0e8a53eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081934 Sep 13 14:36:36.958032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1948/3808] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:37.980775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:37.981389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:37.987798 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:37.988277 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:37.988710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:37.989393 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:37.989863 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:37.990285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:38.054252 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:38.063539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f199e49e-8f06-4e61-946f-7909b571a6b7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087157 Sep 13 14:36:38.064096 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1861/3809] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:39.086474 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:39.087080 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:39.093507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:39.094013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:39.094444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:39.095118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:39.095568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:39.095983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:39.156130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:39.164251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-207f953b-fbf4-46e7-8c7d-3060c26b49b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081639 Sep 13 14:36:39.164807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1949/3810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:40.187258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:40.187871 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:40.190327 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:40.195652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:40.196134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:40.196570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:40.197257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:40.197713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:40.198704 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:40.265367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:40.273998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1e2e5f7-761c-4d7f-9eef-2f2d4ba5194c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090704 Sep 13 14:36:40.274630 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1862/3811] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:41.296596 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:41.297118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:41.303564 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:41.304036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:41.304465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:41.305139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:41.305589 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:41.306032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:41.366228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:41.375128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1cf61c2d-cf59-46d6-b005-28961cbac536 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082465 Sep 13 14:36:41.375690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1950/3812] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:42.398394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:42.398955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:42.406230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:42.406731 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:42.407157 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:42.407834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:42.408283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:42.408700 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:42.472936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:42.481086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5b307db8-dbe5-47ac-a1a4-b003cd0d6777 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086825 Sep 13 14:36:42.481649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1863/3813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:43.503957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:43.504560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:43.510927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:43.511399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:43.511831 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:43.512507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:43.513179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:43.513361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:43.580031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:43.588026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1f5d400d-af22-4c24-bd16-0598fc6bb28c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087890 Sep 13 14:36:43.589130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1951/3814] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:44.617749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:44.618406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:44.624851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:44.625324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:44.625776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:44.626459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:44.626907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:44.627326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:44.688180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:44.696229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-946e07f2-3f8a-47fd-b8ca-5393d70848c9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082407 Sep 13 14:36:44.696787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1864/3815] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:45.719523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:45.720124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:45.726520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:45.726994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:45.727424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:45.728097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:45.728555 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:45.728966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:45.789818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:45.798382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6148d7f8-e436-40ba-8b3a-5d42e1bef030 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082691 Sep 13 14:36:45.798946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1952/3816] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:36:46.821584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:46.822167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:46.829288 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:46.829790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:46.830223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:46.830902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:46.831352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:46.831778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:46.892154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:46.900467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9aec491f-167d-43d8-86bc-6ad5d00fd7f3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082852 Sep 13 14:36:46.901027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1865/3817] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:47.923918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:47.924449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:47.930374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:47.930855 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:47.931286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:47.931966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:47.932422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:47.932845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:47.993536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:48.002600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b50063e3-0120-4fd7-a021-b076d787009a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083366 Sep 13 14:36:48.003165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1953/3818] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:49.025635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:49.026319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:49.033113 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:49.033592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:49.034058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:49.034742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:49.035197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:49.035614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:49.099701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:49.108032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-24ffc29d-863b-44eb-a283-aeec402031ca tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086440 Sep 13 14:36:49.108601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1866/3819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:50.131144 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:50.131753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:50.134096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=28 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:36:50.139931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:50.140414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:50.140848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:50.141532 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:50.142032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:50.142460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:50.204283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:50.212401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d93be298-5041-41ed-a241-fa0d37d5c2a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085101 Sep 13 14:36:50.212963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1954/3820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:51.236467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:51.237076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:51.243584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:51.244057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:51.244518 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:51.245203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:51.245655 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:51.246269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:51.308880 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:51.317088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f25ab137-6853-4159-ae70-8914d5583db0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085109 Sep 13 14:36:51.317659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1867/3821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:36:52.340485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:52.341093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:52.347808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:52.348289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:52.348724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:52.349411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:52.349900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:52.350324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:52.414056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:52.422643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b578be2e-51c6-43ed-b37e-5c3ca978f72e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086194 Sep 13 14:36:52.423202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1955/3822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:53.445443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:53.446009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:53.452730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:53.453203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:53.453632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:53.454330 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:53.454780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:53.455197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:53.515472 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:53.523795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb27b622-e32f-4aec-86c3-7408c025b2a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082242 Sep 13 14:36:53.524358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1868/3823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:54.548022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:54.548631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:54.555052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:54.555536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:54.555967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:54.556651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:54.557106 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:54.557527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:54.617911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:54.626021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2d3be401-06e2-44f2-aab3-aba43d5d9b18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082507 Sep 13 14:36:54.626683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1956/3824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:55.648616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:55.649222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:55.655821 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:55.656294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:55.656723 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:55.657410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:55.657890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:55.658309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:55.722051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:55.730147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d4eab73-76f9-4aea-89de-366729be4418 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085570 Sep 13 14:36:55.730714 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1869/3825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:56.754811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:56.755840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:56.762628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:56.763719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:56.764216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:56.764901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:56.765361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:56.765801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:56.831798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:56.840099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b32f95b0-6ce0-40c4-aa1f-7a9a084901ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089451 Sep 13 14:36:56.840664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1957/3826] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:57.863133 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:57.863674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:57.870061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:57.870543 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:57.870982 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:57.871662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:57.872114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:57.872603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:57.936024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:57.944043 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-eabe6345-b0bf-4d29-b423-686f70219992 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084951 Sep 13 14:36:57.944603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1870/3827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:36:58.968035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:36:58.968632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:36:58.975070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:58.975546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:58.975972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:58.976648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:36:58.977098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:36:58.977514 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:36:59.040006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:36:59.049033 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8048319-ba93-44b1-b5b7-27df3e95f3e0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085372 Sep 13 14:36:59.049584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1958/3828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:36:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:00.071482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:00.072121 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:00.078753 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:00.079232 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:00.079662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:00.080343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:00.080799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:00.081218 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:00.141679 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:00.150092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-14a61e31-bc97-49d6-9c5a-624e805741c2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082461 Sep 13 14:37:00.150648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1871/3829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:01.172902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:01.173516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:01.179991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:01.180468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:01.180902 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:01.181593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:01.182075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:01.182498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:01.245249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:01.254329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bca4ff6b-3a59-44b0-afb8-3fbdef730994 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085862 Sep 13 14:37:01.254890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1959/3830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:02.277913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:02.278520 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:02.285048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:02.285523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:02.285984 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:02.286668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:02.287122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:02.287542 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:02.348056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:02.356140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-25446f71-0ecc-4b00-ab7a-d9fe58d81988 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082102 Sep 13 14:37:02.356705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1872/3831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:03.379992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:03.380547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:03.387178 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:03.387667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:03.388096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:03.389382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:03.389954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:03.390296 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:03.392834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=86 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:03.452752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:03.460801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-985ded64-e056-4adb-a069-4cb4473c25f4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084726 Sep 13 14:37:03.461354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1960/3832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:04.484312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:04.484955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:04.491413 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:04.491891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:04.492326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:04.493009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:04.493460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:04.493952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:04.497861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:04.555549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:04.563639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-09e80c30-2d93-4fc2-892c-307ac77b052d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083631 Sep 13 14:37:04.564203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1873/3833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:05.589383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:05.590031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:05.597275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:05.597772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:05.598204 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:05.598882 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:05.599329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:05.599774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:05.659964 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:05.667925 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-792d69a8-8a87-4871-b1bb-ccbbad127fa2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082386 Sep 13 14:37:05.668475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1961/3834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:06.692287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:06.692899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:06.699451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:06.699930 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:06.700368 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:06.701056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:06.701575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:06.702033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:06.766320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:06.774639 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0ab67928-f2d5-400f-b626-dd789f01afd4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086194 Sep 13 14:37:06.775216 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1874/3835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:07.798440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:07.798942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:07.805275 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:07.805770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:07.806246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:07.806921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:07.807367 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:07.807784 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:07.869887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:07.878630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1505aed9-2799-44c5-9e5b-86fbe12beda9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084135 Sep 13 14:37:07.879186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1962/3836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:08.902952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:08.903555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:08.910229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:08.910705 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:08.911130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:08.911815 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:08.912262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:08.912680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:08.980080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:08.990144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb0c5cb9-1a5f-4065-b07f-d77e5a633bfb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090831 Sep 13 14:37:09.002501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1875/3837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:10.015243 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:10.016028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:10.023470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:10.024129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:10.024628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:10.026531 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:10.026999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:10.027565 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:10.086342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-08392cab-cc0c-491b-a9e2-53786359e954 req-ecdd7229-694d-4ad5-9c89-e126e83987e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2c4488-4c00-4d44-ae73-a78e48c07a1b", "name": "network-vif-deleted", "tag": "8fdade93-346e-4a95-b7eb-77293643fb50"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:37:10.097249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-08392cab-cc0c-491b-a9e2-53786359e954 req-ecdd7229-694d-4ad5-9c89-e126e83987e0 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:10.097716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-08392cab-cc0c-491b-a9e2-53786359e954 req-ecdd7229-694d-4ad5-9c89-e126e83987e0 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:10.098171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-08392cab-cc0c-491b-a9e2-53786359e954 req-ecdd7229-694d-4ad5-9c89-e126e83987e0 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:10.099036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:10.108145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-616efd88-d09c-4036-871e-831182132a70 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.096909 Sep 13 14:37:10.109945 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-08392cab-cc0c-491b-a9e2-53786359e954 req-ecdd7229-694d-4ad5-9c89-e126e83987e0 service nova] Creating event network-vif-deleted:8fdade93-346e-4a95-b7eb-77293643fb50 for instance 7b2c4488-4c00-4d44-ae73-a78e48c07a1b on hv-cinder-85743 Sep 13 14:37:10.113862 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1963/3838] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:10.115510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-08392cab-cc0c-491b-a9e2-53786359e954 req-ecdd7229-694d-4ad5-9c89-e126e83987e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Sep 13 14:37:10.116280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1876/3839] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:37:11.131119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:11.131727 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:11.138137 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:11.139129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:11.139562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:11.140246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:11.140699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:11.141119 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:11.202742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:11.210769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-69896ee9-c35e-4381-823a-21a07ec39be2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083649 Sep 13 14:37:11.211321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1964/3840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:12.235824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:12.236524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:12.238464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=30 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:12.244029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:12.244534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:12.244955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:12.245663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:12.246485 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:12.246921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:12.312708 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:12.320783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-86f6c24d-7206-4bed-a575-83377097bc03 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.090431 Sep 13 14:37:12.321347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1877/3841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:13.344356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:13.344913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:13.351858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:13.352338 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:13.352769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:13.353449 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:13.353950 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:13.354371 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:13.418107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:13.427185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-291bea34-cebf-4163-a7d4-246d420f1662 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087123 Sep 13 14:37:13.427745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1965/3842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:14.450222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:14.450824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:14.457964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:14.458434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:14.458859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:14.459536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:14.459979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:14.460426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:14.521318 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:14.531459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-15ded67f-6e1f-45a0-84f0-82c2a3238330 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085063 Sep 13 14:37:14.532031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1878/3843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:15.554852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:15.555484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:15.562646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:15.563145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:15.563572 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:15.564246 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:15.564692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:15.565143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:15.625971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:15.634241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d11df1d6-307d-47dd-9093-76ba319a1e58 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083278 Sep 13 14:37:15.634863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1966/3844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:16.657707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:16.658357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:16.664661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:16.665137 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:16.665570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:16.666352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:16.666803 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:16.667223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:16.728131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:16.736460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-267c8ce8-f984-4da2-8e78-8d4c98fdd2ce tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082648 Sep 13 14:37:16.737017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1879/3845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:17.759841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:17.760376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:17.766385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:17.766865 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:17.767291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:17.767968 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:17.768419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:17.768835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:17.834917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:17.843304 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-17212f62-4629-4ef9-867d-86c47d9cbb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087604 Sep 13 14:37:17.843859 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1967/3846] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:18.867320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:18.867841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:18.874495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:18.874974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:18.875407 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:18.876089 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:18.876540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:18.876959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:18.939112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:18.947436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a7bf7680-a2d2-4863-8138-d0e07a007ea7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084051 Sep 13 14:37:18.948003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1880/3847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:19.970142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:19.970744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:19.977038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:19.977496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:19.977953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:19.978627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:19.979078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:19.979494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:20.041207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:20.049242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3042b2c3-cff9-4b24-8a5c-e9426cbc9de1 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083520 Sep 13 14:37:20.049811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1968/3848] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:21.071923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:21.072526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:21.079170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:21.079642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:21.080070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:21.080759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:21.081208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:21.081659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:21.147616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:21.156201 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26501711-11c3-461f-a0d0-5c6597208a98 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088166 Sep 13 14:37:21.156773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1881/3849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:22.179704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:22.180321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:22.182664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=30 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:22.188876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:22.189362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:22.189835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:22.190529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:22.190990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:22.191409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:22.253780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:22.261899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b2bc1ab-b06a-4c45-be01-f339962edc45 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086048 Sep 13 14:37:22.262465 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1969/3850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:23.285005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:23.285601 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:23.292830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:23.293306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:23.293810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:23.294441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:23.294890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:23.295483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:23.355367 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:23.363547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ddd36a5e-8d86-479a-9150-9fdcd529f8fb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082415 Sep 13 14:37:23.364109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1882/3851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:24.387253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:37:24.387778 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:37:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 (ip 10.222.0.20) !!! Sep 13 14:37:24.521941 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:24.522804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:24.529388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:24.529919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:24.530351 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:24.531037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:24.531490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:24.531907 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:24.593148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:24.601206 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bcd78d2c-b638-44c5-a389-da52d026df6d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.218594 Sep 13 14:37:24.601775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1970/3852] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:25.623335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:25.623948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:25.630380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:25.630860 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:25.631304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:25.631990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:25.632447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:25.632872 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:25.693784 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:25.702166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78e89a3b-a37c-46bb-8a1b-2095dbd7b403 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082735 Sep 13 14:37:25.702726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1883/3853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:37:26.725088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:26.725690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:26.732657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:26.733132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:26.733557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:26.734254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:26.734706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:26.735215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:26.797842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:26.805827 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e2ef3dea-e12e-407a-b089-a444133f2caa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084555 Sep 13 14:37:26.806382 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1971/3854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:27.829337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:27.829893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:27.836300 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:27.836778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:27.837211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:27.837937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:27.838379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:27.838799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:27.903350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:27.911440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a9e789a-ec38-42ec-beb9-a6d81a31aac0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086800 Sep 13 14:37:27.912005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1884/3855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:28.934405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:28.934918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:28.941282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:28.941789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:28.942217 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:28.942917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:28.943362 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:28.943776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:29.005254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:29.014042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e3e4cb75-4a37-4a2e-bffc-743aaf391167 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082847 Sep 13 14:37:29.014605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1972/3856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:30.037970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:30.038605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:30.045911 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:30.046382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:30.046811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:30.047493 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:30.047928 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:30.048344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:30.111559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:30.119654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-69ad37d1-3460-4735-8fea-a32418a1e836 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085675 Sep 13 14:37:30.120214 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1885/3857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:31.142901 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:31.143510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:31.150146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:31.150627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:31.151059 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:31.151741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:31.152194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:31.152613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:31.213844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:31.222510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7c475b7c-aeca-43bc-9d4e-f808baab1eed tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083587 Sep 13 14:37:31.223067 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1973/3858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:32.245476 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:32.246103 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:32.252610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:32.253078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:32.253503 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:32.254205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:32.254652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:32.255069 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:32.315331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:32.323412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7deb3060-fdae-4171-ba15-27eeaf4b3a47 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081790 Sep 13 14:37:32.323974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1886/3859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:33.346337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:33.346951 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:33.353593 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:33.354114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:33.354554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:33.355241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:33.355703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:33.356129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:33.416691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:33.418885 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=88 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:33.426949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1684cba8-7bbd-4ff6-9fc9-3aca8d9d7bb5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084467 Sep 13 14:37:33.427515 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1974/3860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:34.449473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:34.450120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:34.457345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:34.457855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:34.458286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:34.458967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:34.459416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:34.459834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:34.522692 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:34.524916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:34.532166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-26601a8f-4ca0-4bfd-99f1-098b2f1c2c1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086461 Sep 13 14:37:34.532737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1887/3861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:35.555312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:35.555912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:35.562385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:35.562867 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:35.563293 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:35.563967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:35.564417 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:35.564836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:35.627787 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:35.635888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28287d7b-3639-433d-b787-184d3d39a8ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084463 Sep 13 14:37:35.636448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1975/3862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:37:36.659963 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:36.660564 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:36.667057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:36.667534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:36.667965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:36.668671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:36.669112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:36.669537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:36.739800 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:36.748818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a1dddde9-1923-4335-905b-762bd0d810b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.092858 Sep 13 14:37:36.749402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1888/3863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:37.772488 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:37.773087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:37.780303 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:37.780712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:37.781145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:37.781853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:37.782309 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:37.782730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:37.845082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:37.853403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28a59972-f831-469b-86f4-12cd8bcff345 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085014 Sep 13 14:37:37.853987 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1976/3864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:38.877062 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:38.877631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:38.879876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:37:38.880055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 (ip 10.222.0.20) !!! Sep 13 14:37:38.886609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:38.887092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:38.887524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:38.888484 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:38.888961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:38.889384 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:38.958317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:38.967273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-154ca6bb-8284-400c-9785-c75eb3916197 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.094774 Sep 13 14:37:38.967862 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1889/3865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:39.990360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:39.990962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:39.993017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:37:39.993194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:37:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 (ip 10.222.0.20) !!! Sep 13 14:37:40.005214 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:40.005692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:40.006151 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:40.006834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:40.007282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:40.007701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:40.069335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:40.077873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d87112d-d79c-4d96-aa6c-8900284a4f65 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.091301 Sep 13 14:37:40.078431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1977/3866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:41.100417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:41.101019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:41.107426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:41.107926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:41.108361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:41.109072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:41.109525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:41.109981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:41.170404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:41.178439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-12e877d5-03bd-48e7-ad18-0b3a0823ee46 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081881 Sep 13 14:37:41.179003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1890/3867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:41 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:42.202107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:42.202716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:42.209115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:42.209595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:42.210061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:42.210748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:42.211203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:42.211629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:42.275503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:42.284256 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e0745dc-4dd3-41a1-ba70-221a495252d4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086393 Sep 13 14:37:42.284813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1978/3868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:43.306962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:43.307624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:43.310824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:43.316199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:43.316682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:43.317118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:43.317832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:43.318291 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:43.318716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:43.379659 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:43.388176 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ac72859-b9ed-4966-ad2a-a7a94f0f4cc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084858 Sep 13 14:37:43.388788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1891/3869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:37:44.411471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:44.412101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:44.418448 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:44.419111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:44.419544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:44.420223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:44.420667 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:44.421081 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:44.491038 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:44.501191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8d8a4633-f861-4d98-91d3-80f151001f02 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.093517 Sep 13 14:37:44.501764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1979/3870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:45.524724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:45.525364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:45.532441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:45.532914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:45.533342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:45.534044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:45.534492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:45.534905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:45.595148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:45.603236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-11b6005b-4352-417f-83ad-be319f87828e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082673 Sep 13 14:37:45.603794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1892/3871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:46.627221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:46.627849 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:46.634563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:46.635046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:46.635478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:46.636165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:46.636623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:46.637036 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:46.697675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:46.705814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-17521cde-d74d-4356-ac32-b11db29212ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083436 Sep 13 14:37:46.706379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1980/3872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:47.728744 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:47.729345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:47.736677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:47.737152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:47.737586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:47.738362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:47.738806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:47.739223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:47.810378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:47.818669 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-183f6d19-29db-4aeb-a029-346e74c103b9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.093800 Sep 13 14:37:47.819242 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1893/3873] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:48.840733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:48.841289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:48.847750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:48.848233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:48.848673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:48.849353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:48.849834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:48.850259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:48.912494 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:48.921044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2b4295c8-3d1a-48b5-8b51-8303ca4aff2c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084340 Sep 13 14:37:48.921613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1981/3874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:49.944308 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:49.944929 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:49.952076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:49.952557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:49.952987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:49.953672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:49.954154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:49.954578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:50.017258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:50.025553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e36cf251-6874-473c-9b75-d91f9ea38f30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085117 Sep 13 14:37:50.026149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1894/3875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:51.049413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:51.050045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:51.056422 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:51.056900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:51.057329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:51.058031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:51.058487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:51.058906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:51.118892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:51.127035 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-24552cc4-f146-4d80-89eb-4dcdbca76790 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081415 Sep 13 14:37:51.127597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1982/3876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:52.150458 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:52.151070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:52.158750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:52.159233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:52.159672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:52.160383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:52.160826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:52.161249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:52.222169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:52.230360 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d3c3ad06-7c3c-4bfa-84f7-0283145d7d99 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084353 Sep 13 14:37:52.230926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1895/3877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:53.253750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:53.254378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:53.256675 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=28 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:37:53.261993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:53.263211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:53.263789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:53.264475 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:53.264928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:53.265346 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:53.328899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:53.336980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f820a89d-1ffc-4827-ba75-435c951aa761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087097 Sep 13 14:37:53.337543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1983/3878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:54.359626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:54.360251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:54.366294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:54.366763 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:54.367187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:54.367867 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:54.368307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:54.368719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:54.429780 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:54.444726 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c685c33-86e1-40fb-84fd-d204da3e7617 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089480 Sep 13 14:37:54.445320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1896/3879] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:55.468005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:55.468606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:55.474955 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:55.475428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:55.475856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:55.476533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:55.476982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:55.477403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:55.538673 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:55.547283 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-86ea9b9b-6078-4e1d-ae06-e669f777160d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083336 Sep 13 14:37:55.547848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1984/3880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:56.570697 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:56.571307 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:56.578198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:56.578678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:56.579111 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:56.579794 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:56.580250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:56.580675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:56.644897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:56.653752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c33859c-e134-42ca-8efa-8b36f8251491 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086726 Sep 13 14:37:56.654321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1897/3881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:57.677103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:57.677683 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:57.684634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:57.685107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:57.685533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:57.686233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:57.686680 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:57.687093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:57.748974 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:57.757029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bda439d3-1d7d-4ad1-8bf7-9d3d0dfff62e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083734 Sep 13 14:37:57.757597 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1985/3882] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:58.780626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:58.781161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:58.787940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:58.788590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:58.789184 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:58.789903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:58.790623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:58.791364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:58.859670 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:37:58.868015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-993c6779-7611-4241-a012-e972d7922fe7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.091317 Sep 13 14:37:58.868579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1898/3883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:37:59.891807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:37:59.892866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:37:59.895446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:37:59.895631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 (ip 10.222.0.20) !!! Sep 13 14:37:59.902143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:59.902733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:59.903485 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:37:59.904302 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:37:59.904769 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:37:59.905199 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:00.125509 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:00.133671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-98bc4c2a-22b7-47e7-bcad-b4195c289ccf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.245908 Sep 13 14:38:00.134259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1986/3884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:37:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:01.158168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:01.158808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:01.165211 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:01.165687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:01.166159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:01.166841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:01.167296 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:01.167718 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:01.228991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:01.237785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fa5bc4b8-2cba-42ec-b2f2-c5a948475026 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084287 Sep 13 14:38:01.238350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1899/3885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:02.261833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:02.262439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:02.268813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:02.269287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:02.269716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:02.270412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:02.270856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:02.271279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:02.333699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:02.342852 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-489a1e2c-0995-48f2-a054-9a41635f9364 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084827 Sep 13 14:38:02.343591 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1987/3886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:03.366581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:03.367095 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:03.374456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:03.374935 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:03.375365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:03.376045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:03.376498 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:03.376918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:03.437335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:03.445533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c571891c-1e42-4604-a2b9-360e9d1afe61 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082949 Sep 13 14:38:03.446128 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1900/3887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:04.467904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:04.468544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:04.474892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:04.475374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:04.475806 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:04.476487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:04.476944 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:04.477373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:04.481225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=80 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:04.539014 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:04.547444 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5680bd98-944f-4e83-b208-9f752e40579f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083447 Sep 13 14:38:04.547991 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1988/3888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:05.570511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:05.571146 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:05.577845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:05.578321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:05.578751 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:05.579429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:05.579881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:05.580298 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:05.644891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:05.653255 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49b2e79a-3c24-4e49-97ab-d47d50ea3a2d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086727 Sep 13 14:38:05.653839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1901/3889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:06.676502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:06.677125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:06.683440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:06.684424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:06.684845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:06.685524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:06.686001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:06.686423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:06.746073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:06.754573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b3e68e7b-34a7-48ab-bdc5-d180d81b76ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081986 Sep 13 14:38:06.755122 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1989/3890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:07.778180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:07.778706 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:07.785876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:07.786352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:07.786779 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:07.787456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:07.787904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:07.788324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:07.792213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=86 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:07.849024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:07.857369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0f188fd6-c7b2-4442-b664-7aa6f4360651 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083233 Sep 13 14:38:07.857958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1902/3891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:08.880628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:08.881150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:08.887912 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:08.888393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:08.888825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:08.889513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:08.889999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:08.890424 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:08.950813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:08.958958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-48996a3a-e1f5-42cb-98b8-7a496ac9bf9e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082210 Sep 13 14:38:08.959507 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1990/3892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:09.986720 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:09.987331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:09.993709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:09.994222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:09.994658 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:09.995344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:09.995797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:09.996891 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:10.057584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:10.066275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-71fb8df3-14eb-46f5-b730-5e0019f0c259 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083433 Sep 13 14:38:10.066827 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1903/3893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:11.088439 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:11.089052 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:11.096516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:11.097003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:11.097440 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:11.098170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:11.098629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:11.099055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:11.164413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:11.172693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-bef19a93-1a08-42ae-b4d2-e1ba238dad66 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088151 Sep 13 14:38:11.173279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1991/3894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:38:12.196350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:12.196857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:12.204073 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:12.204546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:12.204970 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:12.205646 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:12.206123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:12.206541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:12.266173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:12.274394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-40127d20-4435-4755-95cf-a04f909c42c3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081969 Sep 13 14:38:12.274944 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1904/3895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:13.297762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:13.298360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:13.304786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:13.305259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:13.305686 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:13.306396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:13.306845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:13.307262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:13.416914 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:13.425679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-28bf1a0c-3852-47cc-bee7-27ce15f17de8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.131930 Sep 13 14:38:13.426258 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1992/3896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:14.448462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:14.449059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:14.451348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:14.456488 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:14.456956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:14.457382 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:14.458083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:14.458532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:14.458949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:14.522637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:14.531638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-716ab3c3-e294-4d6f-ad14-a2ec79883453 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086969 Sep 13 14:38:14.532207 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1905/3897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:15.554103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:15.554707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:15.561662 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:15.562168 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:15.562595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:15.563271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:15.563721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:15.564139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:15.624584 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:15.632672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8f62317d-7aad-4966-99c8-0768515e5786 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082453 Sep 13 14:38:15.633221 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1993/3898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:16.655523 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:16.656142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:16.662703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:16.663178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:16.663613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:16.664304 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:16.664759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:16.665182 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:16.724797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:16.733537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0b267260-96e1-4c3f-8961-bedd71804c84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081979 Sep 13 14:38:16.734134 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1906/3899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:17.756633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:17.757150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:17.763890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:17.764378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:17.764814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:17.765496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:17.765983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:17.766409 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:17.826041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:17.834077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-153f8dfd-f62c-46eb-af59-709fd536dab4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081416 Sep 13 14:38:17.834633 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1994/3900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:18.856730 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:18.857358 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:18.863830 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:18.864306 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:18.864739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:18.865423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:18.865899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:18.866324 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:18.926632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:18.935171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e75022ce-079d-4bb6-a667-411da62f231a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081772 Sep 13 14:38:18.935736 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1907/3901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:19.957547 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:19.958190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:19.964634 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:19.965113 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:19.965554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:19.966813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:19.967334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:19.967753 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:20.034447 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:20.042653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ae4e4683-1b11-47cf-96c3-57e19e45de9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088950 Sep 13 14:38:20.043215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1995/3902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:21.065616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:21.066254 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:21.072600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:21.073078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:21.073511 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:21.074227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:21.074677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:21.075857 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:21.181997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:21.190690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83fca47a-cc62-4ab7-aa2e-6e5a2c53816a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.128926 Sep 13 14:38:21.191253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1908/3903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:21 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:22.213800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:22.214438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:22.221380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:22.221884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:22.222314 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:22.222990 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:22.223438 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:22.223853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:22.284876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:22.292920 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-52d88e60-f601-4a40-8067-5adfc46d730d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082957 Sep 13 14:38:22.293472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1996/3904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:23.316278 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:23.316875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:23.322967 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:23.323438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:23.323864 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:23.324554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:23.325696 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:23.326160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:23.389078 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:23.397535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f67838c6-4051-44d4-8e34-544a418c11ab tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084800 Sep 13 14:38:23.398132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1909/3905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:24.420843 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:24.421425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:24.423744 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=28 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:24.428976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:24.429454 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:24.430048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:24.430735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:24.431185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:24.431606 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:24.491653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:24.499772 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c43631e0-791a-45e1-b23d-2e37088d5112 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082863 Sep 13 14:38:24.500352 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1997/3906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:25.523398 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:25.524055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:25.530995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:25.531473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:25.531900 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:25.532584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:25.533036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:25.533455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:25.594530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:25.602581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-94459a63-343a-460c-9fd6-2564e63c9298 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083263 Sep 13 14:38:25.603147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1910/3907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:26.626072 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:26.626684 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:26.633582 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:26.634167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:26.634653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:26.635414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:26.635927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:26.636384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:26.699869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:26.707851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e7fcb5f7-85fe-441d-b432-fe8bfab3ada0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086226 Sep 13 14:38:26.708402 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1998/3908] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:27.730549 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:27.731345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:27.737976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:27.738452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:27.738883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:27.739569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:27.740018 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:27.740438 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:27.801395 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:27.811074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-51287d68-8998-4697-9913-35a83bbcaedc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084437 Sep 13 14:38:27.811638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1911/3909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:28.834031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:28.834538 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:28.841936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:28.842427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:28.842872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:28.843568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:28.844054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:28.844482 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:28.909163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:28.917265 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec877afe-c13e-4db3-9f52-4f4316f987b2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087180 Sep 13 14:38:28.917838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 1999/3910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:29.940510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:29.941040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:29.947550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:29.948031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:29.948464 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:29.949153 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:29.949608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:29.951007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:30.013538 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:30.021675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-afc6c389-5756-45b3-af64-55fc446f3a26 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085118 Sep 13 14:38:30.022532 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1912/3911] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:31.044411 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:31.045060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:31.051743 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:31.052229 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:31.052670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:31.053365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:31.053851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:31.054282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:31.114878 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:31.123228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f320dd82-8586-419e-ac4a-182e1e1b963b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082652 Sep 13 14:38:31.123791 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2000/3912] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:32.146471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:32.147001 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:32.154107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:32.154582 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:32.155007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:32.155683 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:32.156144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:32.156544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:32.219270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:32.227434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9903ddca-b59e-4aa2-acf9-17dc4440b4f5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084866 Sep 13 14:38:32.227992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1913/3913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:32 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:33.251870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:33.252503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:33.258935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:33.259414 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:33.259848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:33.260528 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:33.260983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:33.261405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:33.321552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:33.329877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-913a6a0c-48a0-4c8b-84a6-2d8fe85975cf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082642 Sep 13 14:38:33.330433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2001/3914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:34.352039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:34.352649 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:34.359259 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:34.359738 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:34.360173 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:34.360856 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:34.361309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:34.361752 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:34.422067 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:34.430269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-945187b6-a9cf-4952-b876-a069a66f1f1a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082105 Sep 13 14:38:34.430837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1914/3915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:35.454418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:35.455044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:35.461481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:35.462008 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:35.462446 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:35.463132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:35.463588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:35.464012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:35.467161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=84 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:35.529027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:35.535350 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-03dbf6ef-8583-4d95-a603-e49adaf71108 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084788 Sep 13 14:38:35.535913 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2002/3916] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:36.559631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:36.560599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:36.566890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:36.567394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:36.567853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:36.568539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:36.568985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:36.569489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:36.646389 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:36.655560 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0e18468d-4b84-4521-8591-55b2e2712f33 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.101046 Sep 13 14:38:36.656141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1915/3917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:37.679560 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:37.680163 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:37.687212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:37.687691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:37.688124 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:37.688814 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:37.689255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:37.689678 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:37.753093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:37.761200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-af84c0f4-0137-4ad5-84de-634b7a7f9b1d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085707 Sep 13 14:38:37.761777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2003/3918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:38.784688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:38.785203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:38.791528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:38.791997 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:38.792420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:38.793108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:38.793602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:38.794041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:38.796569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:38.858441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:38.866548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9dcd03ca-2900-47fc-a109-3d05aee47a84 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085822 Sep 13 14:38:38.867106 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1916/3919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:39.890050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:39.890590 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:39.897336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:39.897854 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:39.898290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:39.899981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:39.900436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:39.900863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:39.962958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:39.971093 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-39171cc5-547c-4387-9666-2f766f7fc758 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085693 Sep 13 14:38:39.971646 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2004/3920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:40.993690 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:40.994315 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:41.000808 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:41.001285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:41.001715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:41.002420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:41.002866 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:41.003286 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:41.064369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:41.072623 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-224554a6-488d-436d-95eb-e1b9c12245a9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082658 Sep 13 14:38:41.073187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1917/3921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:42.097212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:42.098312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:42.107321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:42.107801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:42.108234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:42.108926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:42.109379 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:42.109845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:42.169989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:42.178022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-00b76be9-57a9-4e96-af3c-2b5fe55c22ee tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085009 Sep 13 14:38:42.178575 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2005/3922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:43.201515 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:43.202170 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:43.208526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:43.208999 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:43.209430 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:43.210139 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:43.210589 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:43.211007 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:43.270973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:43.279925 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1189c79-d2f5-4d47-a746-fa3d049462e2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082762 Sep 13 14:38:43.280483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1918/3923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:44.302918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:44.303524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:44.310024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:44.310502 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:44.310935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:44.311614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:44.312062 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:44.312481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:44.372830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:44.381060 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8728f2ba-3ccb-4858-8464-6ea9fd69fb8a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082092 Sep 13 14:38:44.381617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2006/3924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:45.404163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:45.404754 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:45.407235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:45.412483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:45.412938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:45.413366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:45.414088 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:45.414530 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:45.414946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:45.476356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:45.484890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-682ab019-ff39-4d69-8e3c-ce03da190953 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084817 Sep 13 14:38:45.485450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1919/3925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:46.509238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:46.509893 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:46.515998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:46.516481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:46.516916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:46.517601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:46.518092 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:46.518517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:46.582393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:46.590497 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-68a77625-d0c0-44c9-868f-0d55c89668d9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085293 Sep 13 14:38:46.591053 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2007/3926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:47.613905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:47.614505 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:47.620927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:47.621399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:47.621865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:47.622545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:47.622990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:47.623404 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:47.689339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:47.697449 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b0bd7b5c-8fa3-45ab-b69f-886b7789b230 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087451 Sep 13 14:38:47.698036 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1920/3927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:48.720154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:48.720766 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:48.727182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:48.727670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:48.728109 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:48.728800 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:48.729260 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:48.729691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:49.023105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:49.031470 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-26d1828f-e4df-45ef-a9d9-e6aa4f26fb2b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.315275 Sep 13 14:38:49.032031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2008/3928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:50.054684 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:50.055310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:50.061758 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:50.062243 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:50.062678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:50.063359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:50.063814 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:50.064236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:50.129938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:50.138102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb5ccd48-a307-42e9-9e5c-3b5c01dd9319 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087247 Sep 13 14:38:50.138650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1921/3929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:51.162045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:51.162653 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:51.171478 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:51.171971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:51.172392 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:51.173088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:51.173545 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:51.173993 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:51.238503 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:51.246536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-84523a7c-f0f5-4d24-9d11-d1f68b40663a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088327 Sep 13 14:38:51.247099 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2009/3930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:52.269594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:52.270225 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:52.276948 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:52.277416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:52.277902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:52.278577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:52.279022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:52.279436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:52.338946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:52.348013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca825b47-9e1d-4ee7-87f0-fb94da472633 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082162 Sep 13 14:38:52.348581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1922/3931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:52 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:38:53.371325 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:53.371858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:53.378370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:53.378856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:53.379319 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:53.380001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:53.380457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:53.380888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:53.441145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:53.449272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58b4f912-a2d6-458a-93b5-f1fa897a2b09 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081902 Sep 13 14:38:53.449853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2010/3932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:54.471701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:54.472334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:54.478460 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:54.478934 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:54.479361 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:54.480035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:54.480478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:54.480893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:54.543230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:54.551940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-03b62aeb-b053-44ec-ab9b-ba9dde37bc1b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084096 Sep 13 14:38:54.552501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1923/3933] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:55.574324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:55.574971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:55.578029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=28 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:38:55.583541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:55.584026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:55.584464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:55.585155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:55.585614 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:55.586075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:55.651603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:55.659844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-770cecf1-ba3a-4cfb-bd5b-a76a977576aa tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089453 Sep 13 14:38:55.660405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2011/3934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:56.682499 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:56.683100 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:56.690285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:56.690765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:56.691196 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:56.691882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:56.692334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:56.692755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:56.755596 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:56.763834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d97143c4-fc4a-40d8-94ed-dceb0d64aeaf tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085181 Sep 13 14:38:56.764396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1924/3935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:57.787191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:57.787745 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:57.794129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:57.794616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:57.795050 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:57.795731 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:57.796187 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:57.796696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:57.859170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:57.867321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-78709d73-a392-4f06-b56e-fafc92704ab7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084000 Sep 13 14:38:57.867877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2012/3936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:38:58.890788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:58.891450 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:58.898116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:58.898590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:58.899023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:58.899701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:58.900149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:58.900565 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:38:58.960075 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:38:58.968378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b64150bd-776d-4404-a6c8-65cb44658925 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081263 Sep 13 14:38:58.968939 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1925/3937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:38:59.990910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:38:59.991536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:38:59.997928 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:38:59.998410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:38:59.998848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:00.000019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:00.000479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:00.000906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:00.064237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:00.072388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-37c16526-711e-4723-97db-0920908f3ac7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085341 Sep 13 14:39:00.072959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2013/3938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:38:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:01.096663 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:01.097394 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:01.104531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:01.105020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:01.105456 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:01.106179 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:01.106633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:01.107056 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:01.172016 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:01.180662 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-78432b7f-7be6-452e-873c-a04e9e63d08e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088697 Sep 13 14:39:01.181230 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1926/3939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:02.203270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:02.203853 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:02.210457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:02.210926 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:02.211357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:02.212039 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:02.212493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:02.212916 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:02.272959 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:02.281626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8339913-9102-4f4c-bfd8-df884951fda4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082263 Sep 13 14:39:02.282219 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2014/3940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:03.304412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:03.305012 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:03.311526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:03.312000 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:03.312424 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:03.313098 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:03.313544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:03.313990 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:03.374061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:03.382160 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b5f547d6-a98e-45a1-b399-7a7855ec7096 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081620 Sep 13 14:39:03.382717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1927/3941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:03 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:04.404655 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:04.405921 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:04.412487 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:04.412963 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:04.413398 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:04.414104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:04.414557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:04.414976 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:04.475051 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:04.483057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-055b1c28-da1a-4718-a64f-c660831f8c62 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082292 Sep 13 14:39:04.484286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2015/3942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:39:05.506870 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:05.507481 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:05.513883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:05.514363 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:05.514799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:05.515592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:05.516285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:05.516712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:05.582834 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:05.591003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5594fd74-d3ae-4a23-bdb7-787b24c302c4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088020 Sep 13 14:39:05.591576 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1928/3943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:06.613277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:06.613927 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:06.620262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:06.620737 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:06.621166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:06.621880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:06.622337 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:06.622756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:06.627118 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=84 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:06.689313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:06.697403 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-56786e4e-2d8f-4123-ac3f-d50a1e2b5c29 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088149 Sep 13 14:39:06.697994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2016/3944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:07.721321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:07.721969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:07.728378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:07.728852 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:07.729279 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:07.730010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:07.730457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:07.730873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:07.790475 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:07.798568 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-170f9f26-401b-4d4f-b90b-13ee03d91ee0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081730 Sep 13 14:39:07.799126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1929/3945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:08.821375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:08.821936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:08.828270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:08.828741 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:08.829170 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:08.829880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:08.830333 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:08.830751 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:08.890356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:08.898550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cfde1e99-14c3-4bad-bc14-2c902d83588f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081080 Sep 13 14:39:08.899102 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2017/3946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:09.922091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:09.922616 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:09.928965 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:09.929444 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:09.929937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:09.930622 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:09.931074 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:09.931500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:09.935386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:09.992519 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:10.001265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ec395aad-5dcd-4c6b-a796-54a47880fd75 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083757 Sep 13 14:39:10.001836 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1930/3947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:11.024374 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:11.024985 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:11.031493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:11.031975 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:11.032410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:11.033101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:11.033554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:11.034016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:11.096729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:11.105114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e4051f59-5939-4acf-a6f9-0ad860c667ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084579 Sep 13 14:39:11.105415 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2018/3948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:12.127899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:12.128436 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:12.134819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:12.135295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:12.135724 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:12.136405 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:12.136861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:12.137280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:12.198420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:12.207605 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f504f6de-0989-4f48-ada5-9c6b24a96362 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083743 Sep 13 14:39:12.208167 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1931/3949] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:13.231266 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:13.231876 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:13.239056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:13.239542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:13.239982 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:13.240668 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:13.241128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:13.241554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:13.304373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:13.312714 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0d1c5800-da58-488c-888f-7a40f748941a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085297 Sep 13 14:39:13.313269 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2019/3950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:13 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:14.335890 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:14.336496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:14.343035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:14.343602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:14.344029 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:14.344707 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:14.345155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:14.345575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:14.411612 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:14.419842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2d8021c8-d9c9-42b0-a8fb-7cf5358a633c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087852 Sep 13 14:39:14.420412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1932/3951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:15.443578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:15.444084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:15.450557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:15.451032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:15.451463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:15.452139 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:15.453223 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:15.453717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:15.516776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:15.525208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e321ffc8-13ca-4b68-9f3b-d28cc607f4a2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085606 Sep 13 14:39:15.525998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2020/3952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:16.548536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:16.549166 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:16.551597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:16.557063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:16.557537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:16.557991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:16.558668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:16.559114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:16.559527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:16.620031 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:16.628357 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f1b7f13e-73f6-497f-9b64-c20d6590239e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084495 Sep 13 14:39:16.628913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1933/3953] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:17.652884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:17.653493 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:17.660703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:17.661195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:17.661635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:17.662354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:17.662811 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:17.663238 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:17.728360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:17.736840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-547e3a4a-aec6-4e67-b064-e12c73c2ec18 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087991 Sep 13 14:39:17.737405 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2021/3954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:18.759161 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:18.759789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:18.766640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:18.767122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:18.767558 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:18.768247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:18.768703 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:18.769132 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:18.830611 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:18.838635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5ea5bdba-88a6-4b93-914b-bc25eb003a0e tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083313 Sep 13 14:39:18.839200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1934/3955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:19.862842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:19.863412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:19.869691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:19.870200 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:19.870629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:19.871307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:19.871762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:19.872180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:19.932997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:19.941648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-da27d48a-9629-4149-a58d-27469620f761 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083298 Sep 13 14:39:19.942231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2022/3956] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:20.964478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:20.965081 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:20.972459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:20.972954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:20.973380 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:20.974086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:20.974535 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:20.974949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:21.037340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:21.045480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-270b8e62-f71d-4bc6-98f5-bdbf8c6bbe8d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084872 Sep 13 14:39:21.046691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1935/3957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:20 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:22.068719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:22.069308 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:22.076042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:22.076524 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:22.076960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:22.077688 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:22.078164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:22.078585 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:22.139149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:22.147573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-53e3002d-fa74-413e-95a4-cbd6553f8fdd tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082489 Sep 13 14:39:22.148130 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2023/3958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:22 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:23.169686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:23.170325 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:23.176903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:23.177379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:23.177841 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:23.178525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:23.178972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:23.179391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:23.241884 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:23.250839 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-83a87584-f217-4a45-be94-0b35805f4568 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084959 Sep 13 14:39:23.251419 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1936/3959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:23 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:24.273759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:24.274396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:24.284145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:24.284629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:24.285681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:24.286400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:24.286919 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:24.287341 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:24.351182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:24.359468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c997b6f8-94fd-4ca6-8f0a-33c2a388628d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089948 Sep 13 14:39:24.360026 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2024/3960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:24 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:39:25.382320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:25.382915 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:25.389280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:25.389772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:25.390206 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:25.390958 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:25.391408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:25.391823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:25.451904 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:25.460118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cbec3d4b-45b5-4fc0-9112-28d62efe4231 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081685 Sep 13 14:39:25.460677 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1937/3961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:25 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:26.483529 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:26.484188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:26.486740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=28 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:26.492136 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:26.492651 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:26.493089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:26.493813 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:26.494271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:26.494695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:26.557380 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:26.565602 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7dd0ed65-42d4-44b7-aa5f-48148aff3ea3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086137 Sep 13 14:39:26.566194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2025/3962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:26 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:27.588613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:27.589224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:27.596374 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:27.596848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:27.597275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:27.597977 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:27.598428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:27.598843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:27.659213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:27.667282 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6820839d-0b15-4527-9089-32625b69719d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082593 Sep 13 14:39:27.667837 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1938/3963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:27 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:28.691005 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:28.691603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:28.698121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:28.698595 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:28.699020 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:28.699701 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:28.700148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:28.700563 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:28.760943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:28.769611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9d2a0a69-dadc-406e-a404-ba945bd2f368 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082935 Sep 13 14:39:28.770188 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2026/3964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:28 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:29.792675 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:29.793203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:29.799687 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:29.800163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:29.800597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:29.801270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:29.801716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:29.802155 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:29.862597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:29.870643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-49ab1526-d0cf-44e1-be0f-0450d4b09798 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081898 Sep 13 14:39:29.871212 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1939/3965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:29 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:30.895292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:30.895830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:30.902452 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:30.902933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:30.903368 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:30.904055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:30.904508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:30.904934 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:30.966332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:30.975021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-66ff9354-02e7-41d8-8ff9-8744d468b589 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083814 Sep 13 14:39:30.975580 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2027/3966] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:30 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:31.997698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:31.998302 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:32.005215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:32.005689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:32.006158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:32.006835 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:32.007280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:32.007694 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:32.071666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:32.080045 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8b2fbf2a-dbf1-4c13-8c3f-c4b0e6f28f81 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086197 Sep 13 14:39:32.080603 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1940/3967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:31 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:33.102952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:33.103578 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:33.110496 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:33.110966 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:33.111395 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:33.112069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:33.112523 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:33.112939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:33.176252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:33.184342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2d6536b8-f63f-4a0b-b668-b7adf228c2b0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085243 Sep 13 14:39:33.184899 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2028/3968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:33 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:34.207642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:34.208281 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:34.215094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:34.215581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:34.216019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:34.216713 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:34.217169 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:34.217591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:34.287269 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:34.295531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7c535694-8e81-4ed5-8fce-207194618d93 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.091681 Sep 13 14:39:34.296105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1941/3969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:34 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:35.319115 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:35.319742 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:35.326407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:35.326881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:35.327312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:35.328132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:35.328670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:35.329087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:35.389361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:35.397994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d59d2176-5501-4d8a-9d3e-7f926841235d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082685 Sep 13 14:39:35.398561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2029/3970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:35 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:36.421227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:36.422610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:36.429057 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:36.429533 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:36.429998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:36.430678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:36.431129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:36.431547 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:36.492301 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:36.500932 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3b878157-74b7-4edf-b729-349dae5c376c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083394 Sep 13 14:39:36.501516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1942/3971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:36 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:37.524645 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:37.525301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:37.532962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:37.533442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:37.537315 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:37.538065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:37.539355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:37.539782 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:37.542608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=84 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:37.601460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:37.609690 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-286576e1-5a05-4ae1-acc3-3c28d51bc6ff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089060 Sep 13 14:39:37.610277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2030/3972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:37 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:38.632224 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:38.632831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:38.634819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:39:38.634964 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 (ip 10.222.0.20) !!! Sep 13 14:39:38.646415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:38.646889 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:38.647571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:38.648247 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:38.648693 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:38.649110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:38.712489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:38.720795 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f73bf007-08c8-4996-89ac-de5de6c56bbc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.092366 Sep 13 14:39:38.721347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1943/3973] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:38 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:39.744307 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:39.744910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:39.751904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:39.752384 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:39.752819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:39.753501 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:39.753989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:39.754435 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:39.816740 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:39.824844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f53a8cd1-526c-4854-bd51-527e78fe1338 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084381 Sep 13 14:39:39.825408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2031/3974] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:39 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:40.848295 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:40.848849 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:40.855678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:40.856148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:40.856571 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:40.857246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:40.857719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:40.858156 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:40.860845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:40.933082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:40.941495 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6811c547-8aae-4712-b5ee-83b77da49d6b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.097833 Sep 13 14:39:40.942094 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1944/3975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:40 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:42.020412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:42.021021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:42.030143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:42.030622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:42.031048 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:42.031733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:42.032185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:42.032600 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:42.096376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:42.105381 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-31f742d0-b9dd-4ecf-8d02-7461e113f7e5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089017 Sep 13 14:39:42.106077 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2032/3976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:42 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:43.128402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:43.129024 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:43.135412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:43.135936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:43.136313 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:43.136991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:43.137439 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:43.137883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:43.198865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:43.207452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bcc4293c-30ef-42db-bb77-b17546d69ab5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082944 Sep 13 14:39:43.208120 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1945/3977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:43 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:44.229786 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:44.230388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:44.237660 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:44.238247 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:44.238682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:44.239373 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:44.239883 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:44.240357 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:44.302519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:44.310544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f1ab21c9-e058-4fab-a07d-3aff625607a5 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084704 Sep 13 14:39:44.311097 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2033/3978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:44 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:45.337451 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:45.338185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:45.345025 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:45.345500 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:45.346092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:45.346772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:45.347220 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:45.347638 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:45.408954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:45.417040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-48b39046-3a60-48bb-b881-b284edfbdd30 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083403 Sep 13 14:39:45.417609 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1946/3979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:45 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:46.441141 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:46.441654 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:46.447774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:46.448250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:46.448681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:46.449354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:46.449835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:46.450259 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:46.510629 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:46.519467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-2047ab29-da91-4225-a6d0-947bb7a1b31a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083141 Sep 13 14:39:46.520027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2034/3980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:46 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:47.542973 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:47.543588 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:47.546107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:47.551469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:47.551952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:47.552390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:47.553083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:47.553540 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:47.553994 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:47.619195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:47.627685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5df28a54-be21-4698-b534-9fd897b8f61b tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088693 Sep 13 14:39:47.628256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1947/3981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:47 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:48.651469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:48.652075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:48.659191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:48.659669 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:48.660105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:48.660783 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:48.661242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:48.661664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:48.722342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:48.730481 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5451f12b-e8bd-44d4-9352-49ee642a8644 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083185 Sep 13 14:39:48.731042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2035/3982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:48 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:49.754017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:49.754626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:49.760986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:49.761459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:49.761919 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:49.762599 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:49.763050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:49.763468 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:49.824048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:49.832888 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a655572f-b799-4abc-b681-e5ca0a94f339 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082914 Sep 13 14:39:49.833455 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1948/3983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:49 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:50.856389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:50.856972 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:50.863864 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:50.864343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:50.864777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:50.865460 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:50.865942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:50.866377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:50.929096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:50.937241 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0bde66f4-675d-4d12-916c-b38cd5bd983c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084822 Sep 13 14:39:50.937809 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2036/3984] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:50 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:51.960080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:51.960688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:51.967130 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:51.967607 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:51.968145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:51.969507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:51.969991 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:51.970417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:52.029907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:52.038602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4a2ff31b-2d01-44f5-b80d-15462b170669 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082421 Sep 13 14:39:52.039172 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1949/3985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:51 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:53.061336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:53.062203 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:53.068626 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:53.069103 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:53.069537 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:53.070252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:53.070706 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:53.071129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:53.133336 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:53.141551 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6563fe31-24b7-4fd7-9db1-fb57b68e1fff tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084108 Sep 13 14:39:53.142148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2037/3986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:53 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:54.164474 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:54.165084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:54.171233 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:54.171847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:54.172283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:54.172966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:54.173426 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:54.173887 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:54.233011 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:54.241275 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f119fe95-55c5-4ce2-b5c2-f4796646e074 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.080744 Sep 13 14:39:54.241865 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1950/3987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:54 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:55.264556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:55.265877 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:55.272540 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:55.273016 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:55.273445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:55.274152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:55.274608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:55.275030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:55.337073 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:55.345242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-93b16917-9eea-4765-b561-947ccfa9e8a0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084623 Sep 13 14:39:55.345826 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2038/3988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:55 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:56.369041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:56.369688 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:56.376322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:56.376805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:56.377241 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:56.377959 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:56.378420 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:56.378847 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:56.442592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:56.450712 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-02f1607e-e29e-44a3-b376-18dc89d3448d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.085935 Sep 13 14:39:56.451280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1951/3989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:56 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:57.474410 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:57.475012 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:57.477287 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=28 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:39:57.482442 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:57.482918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:57.483349 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:57.484724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:57.485174 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:57.485592 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:57.550705 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:57.558775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3fcc5282-a198-49fe-91c5-05e6daa5e4f2 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.088214 Sep 13 14:39:57.559433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2039/3990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:57 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:58.581897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:58.582506 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:58.588969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:58.589443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:58.589913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:58.590618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:58.591051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:58.591471 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:58.652490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:58.660782 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ea9c31bd-b43a-4095-984f-01dd385bd826 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082764 Sep 13 14:39:58.661350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1952/3991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:58 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:39:59.684500 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:39:59.685105 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:39:59.692712 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:59.693192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:59.693676 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:59.694388 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:39:59.694844 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:39:59.695262 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:39:59.762900 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:39:59.771958 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cd0c96e6-3979-4f27-aafc-2fd6d85ee513 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.091285 Sep 13 14:39:59.772788 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2040/3992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:39:59 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:00.796402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:00.796940 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:00.803329 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:00.803807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:00.804244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:00.804927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:00.805375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:00.805832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:00.865573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:00.873640 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6a86d5c7-ff17-4f29-83fe-44732c80d0e3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081311 Sep 13 14:40:00.874342 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1953/3993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:00 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:01.896297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:01.896939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:01.903622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:01.904107 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:01.904542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:01.905871 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:01.906354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:01.906798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:01.966851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:01.975635 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d419c7a9-7a84-4ee8-a062-4fc5285a95d7 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083281 Sep 13 14:40:01.976191 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2041/3994] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:01 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:02.999916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:03.000557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:03.008017 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:03.008521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:03.009151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:03.009986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:03.010434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:03.010853 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:03.074776 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:03.083186 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-16821964-43c5-4bc6-8211-6714ee8ded60 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087830 Sep 13 14:40:03.083756 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1954/3995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:02 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:04.106029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:04.106638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:04.113121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:04.113594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:04.114056 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:04.114768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:04.115222 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:04.115643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:04.177041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:04.185159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-167b5c94-40df-4c53-a6e3-c1adb43f68da tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.083029 Sep 13 14:40:04.185750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2042/3996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:04 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:05.214733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:05.215415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:05.224634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:05.225116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:05.225544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:05.226369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:05.226817 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:05.227234 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:05.291699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:05.299809 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-97d7b557-e3bc-4c11-a8c7-8ba2d10d5d6c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089260 Sep 13 14:40:05.300369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1955/3997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:05 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:06.322328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:06.322935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:06.330322 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:06.330801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:06.331228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:06.331906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:06.332360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:06.332775 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:06.394335 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:06.402617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ca4364c7-ff3d-4a69-a699-2de395192394 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084150 Sep 13 14:40:06.403173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2043/3998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:06 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:07.427014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:07.427551 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:07.434044 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:07.434525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:07.434962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:07.435654 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:07.436109 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:07.436785 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:07.497092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:07.505625 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-76505782-48c9-4017-a731-388c98272b95 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082616 Sep 13 14:40:07.506227 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1956/3999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:07 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:08.528707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:08.529313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:08.536311 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:08.536789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:08.537218 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:08.537949 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:08.538400 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:08.538818 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:08.542693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=84 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:40:08.604145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:08.612759 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72a25eab-90ec-4fbb-b298-ca67e41efb37 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.087943 Sep 13 14:40:08.613310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2044/4000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:08 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:09.636490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:09.637093 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:09.644314 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:09.644791 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:09.645222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:09.645937 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:09.646396 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:09.646818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:09.706819 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:09.714851 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-342e1b4d-eb25-46d1-b1ee-cadaf816c9be tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082273 Sep 13 14:40:09.715415 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1957/4001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:09 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:10.738838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:10.739498 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:10.746790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:10.747334 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:10.747977 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:10.748703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:10.749179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:10.749619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:10.811331 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:10.819464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1d14fbe9-2bf1-465f-be0b-f4ce9fe0a5d8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084564 Sep 13 14:40:10.820029 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2045/4002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:10 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:40:11.842229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:11.842916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:11.849397 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:11.849912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:11.850354 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:11.851040 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:11.851496 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:11.851921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:11.854528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=84 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:40:11.914340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:11.922478 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-308a4e0a-0fe7-4543-8d1b-ca83f653ac50 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084178 Sep 13 14:40:11.923050 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1958/4003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:11 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:12.945544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:12.946098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:12.952957 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:12.953427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:12.953887 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:12.954561 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:12.955017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:12.955433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:13.015255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:13.023495 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-46621710-8247-4084-8d88-3c79d5cc8885 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081851 Sep 13 14:40:13.024061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2046/4004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:12 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:14.046049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:14.046650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:14.053084 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:14.053557 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:14.054020 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:14.054698 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:14.055143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:14.055556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:14.117757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:14.126602 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cea55fe6-3ab1-40f6-b97d-2e879ab8a991 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.084339 Sep 13 14:40:14.127151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1959/4005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:14 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:15.150175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:15.150909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:15.157935 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:15.158413 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:15.158838 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:15.159516 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:15.159967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:15.160385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:15.227061 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:15.235490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-7c0cbf46-c86a-45a4-8789-57b3fa85f2f0 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.089425 Sep 13 14:40:15.236084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2047/4006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:15 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:16.258666 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:16.259400 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:16.265826 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:16.266305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:16.266734 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:16.267409 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:16.267855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:16.268271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:16.328660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:16.336701 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e1d15037-9aa9-49ad-91cf-42e8d89ebe36 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.081967 Sep 13 14:40:16.337257 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1960/4007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:16 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:17.360693 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:17.361389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:17.367328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:17.367803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:17.368231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:17.368908 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:17.369356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:17.369828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:17.433473 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:17.442155 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4093c194-111b-4ef3-a72c-967737313edc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.086074 Sep 13 14:40:17.442720 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2048/4008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:17 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:18.465135 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:18.465806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:18.468796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=28 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:40:18.474027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:18.474516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:18.474951 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:18.475650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:18.476108 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:18.476534 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:18.541365 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:18.557189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a8f33f5-76a1-4486-a5d0-1536385370db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.095845 Sep 13 14:40:18.557783 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1961/4009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:18 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:19.580817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:19.581426 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: c77e04fe-3528-40f8-8efb-515a6abe4a83] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:19.587936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:19.588412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:19.588842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:19.589520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:19.590006 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:19.590431 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:19.650767 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:19.658894 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-c92f4436-1763-41a8-b803-beeb854d5919 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83" status: 200 len: 1368 microversion: 2.1 time: 0.082629 Sep 13 14:40:19.659457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2049/4010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:19 2022] GET /compute/v2.1/servers/c77e04fe-3528-40f8-8efb-515a6abe4a83 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:19.681334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-23206b31-4537-4172-9559-021010abfc9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '.version_select at 0x7fc9d42b7040>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:19.700222 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-23206b31-4537-4172-9559-021010abfc9f tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551317523" status: 202 len: 0 microversion: 2.1 time: 0.022627 Sep 13 14:40:19.700775 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1962/4011] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 13 14:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551317523 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:40:20.583511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-0373f7c8-0909-41be-8b91-19554000150d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'create', calling method: .version_select at 0x7fc9d793c0d0>, body: {"keypair": {"name": "tempest-keypair-1949402909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV0jmGtakWmxSA5SGQ36y4cze7LAGwgBlYTRBHsNy0ODlDbdyZbQ2jPrcjqA3upae9nnTUjwQSv0k6AVq3k9Ak9z41sqVsWIRcJKW61hlT0zEvNE2jC+7KenzG0DiPhvQ=="}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:40:20.599679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-0373f7c8-0909-41be-8b91-19554000150d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:40:20.603770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-0373f7c8-0909-41be-8b91-19554000150d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for user 17e8dbc75366467f8fc6f0681e722751 and project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'key_pairs'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:40:20.631234 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-0373f7c8-0909-41be-8b91-19554000150d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051673 Sep 13 14:40:20.631836 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2050/4012] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:40:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:40:21.829150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-840590195", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c8c757b-f3e9-4af8-9cb9-a872eae893ed"}], "security_groups": [{"name": "tempest-securitygroup--1621049633"}], "key_name": "tempest-keypair-1949402909", "user_data": "}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:40:21.934418 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.network.neutron [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] validate_networks() for [('0c8c757b-f3e9-4af8-9cb9-a872eae893ed', None, None, None, None, None)] {{(pid=120643) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:40:22.356163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Flavor limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:40:22.356584 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Image limits 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:40:22.357053 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Flavor pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:40:22.357459 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Image pref 0:0:0 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:40:22.358617 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.virt.hardware [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120643) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:40:22.367490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:22.367969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:22.368403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:22.369123 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:22.369574 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:22.370019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:22.387632 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:40:22.391927 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Getting quotas for user 17e8dbc75366467f8fc6f0681e722751 and project 2fd378f8a7b34d8d82f6a145c62862ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:40:22.403126 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Going to run 1 instances... {{(pid=120643) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:40:22.405876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120643) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:40:22.453824 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-bfce58ec-6a6e-43ff-8774-c105a2363bc9 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629358 Sep 13 14:40:22.454477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1963/4013] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:40:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:40:22.465554 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-08914faf-2bd8-430b-af12-6689658c0be8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:22.466184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-08914faf-2bd8-430b-af12-6689658c0be8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:22.524149 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-08914faf-2bd8-430b-af12-6689658c0be8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:22.532776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-08914faf-2bd8-430b-af12-6689658c0be8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1237 microversion: 2.1 time: 0.070962 Sep 13 14:40:22.533557 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2051/4014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:22 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:23.232032 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-84e2c999-383e-420f-80d7-20573566c29b req-95524faf-c12a-4006-a1bc-1ac773594bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75f1a1a8-03b2-4087-a62a-885a432f4852", "name": "network-vif-deleted", "tag": "5b53af25-2b95-41ce-9f86-e80d09df687e"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:40:23.242740 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-84e2c999-383e-420f-80d7-20573566c29b req-95524faf-c12a-4006-a1bc-1ac773594bfb service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:23.243217 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-84e2c999-383e-420f-80d7-20573566c29b req-95524faf-c12a-4006-a1bc-1ac773594bfb service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:23.243650 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-84e2c999-383e-420f-80d7-20573566c29b req-95524faf-c12a-4006-a1bc-1ac773594bfb service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:23.254733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-84e2c999-383e-420f-80d7-20573566c29b req-95524faf-c12a-4006-a1bc-1ac773594bfb service nova] Creating event network-vif-deleted:5b53af25-2b95-41ce-9f86-e80d09df687e for instance 75f1a1a8-03b2-4087-a62a-885a432f4852 on hv-cinder-85743 Sep 13 14:40:23.261348 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-84e2c999-383e-420f-80d7-20573566c29b req-95524faf-c12a-4006-a1bc-1ac773594bfb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104451 Sep 13 14:40:23.261974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1964/4015] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:40:23.560301 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:23.561111 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:23.567804 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:23.568285 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:23.568732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:23.569433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:23.569923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:23.570356 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:23.635689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:23.643429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-6bda2b58-df6c-46cc-a7d8-774bccc68ac3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1289 microversion: 2.1 time: 0.087013 Sep 13 14:40:23.643999 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2052/4016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:23 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:24.668022 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:24.669343 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:24.675920 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:24.676432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:24.676811 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:24.677507 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:24.677992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:24.678412 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:24.935947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:24.943653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9937ba52-6b77-4a7c-b996-1550bcc9860a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1363 microversion: 2.1 time: 0.280334 Sep 13 14:40:24.944223 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1965/4017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:24 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:25.331632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-59c94ca7-37e8-4cce-94ac-86120b6543f4 req-1ca19e21-8ae2-4b27-b621-83f691747e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b169f1-23a6-45bf-86fd-4891b99420b7", "tag": "9f9fc81f-c8de-479d-84eb-6286534f7dbe"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:40:25.345480 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-59c94ca7-37e8-4cce-94ac-86120b6543f4 req-1ca19e21-8ae2-4b27-b621-83f691747e63 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:25.346132 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-59c94ca7-37e8-4cce-94ac-86120b6543f4 req-1ca19e21-8ae2-4b27-b621-83f691747e63 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:25.347101 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-59c94ca7-37e8-4cce-94ac-86120b6543f4 req-1ca19e21-8ae2-4b27-b621-83f691747e63 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:25.360226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-59c94ca7-37e8-4cce-94ac-86120b6543f4 req-1ca19e21-8ae2-4b27-b621-83f691747e63 service nova] Creating event network-changed:9f9fc81f-c8de-479d-84eb-6286534f7dbe for instance 16b169f1-23a6-45bf-86fd-4891b99420b7 on hv-cinder-85743 Sep 13 14:40:25.366476 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-59c94ca7-37e8-4cce-94ac-86120b6543f4 req-1ca19e21-8ae2-4b27-b621-83f691747e63 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039529 Sep 13 14:40:25.367065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2053/4018] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:40:25.966573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:25.967319 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:25.973897 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:25.974370 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:25.974796 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:25.975490 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:25.975918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:25.976335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:26.103600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:26.111578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-47a84a00-1db4-4089-8f96-2af0a97a5fcc tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1363 microversion: 2.1 time: 0.148809 Sep 13 14:40:26.112143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1966/4019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:25 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:27.134802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:27.135729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:27.146161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:27.146161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:27.146161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:27.146161 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:27.157284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:27.157807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:27.295376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:27.303627 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-88a8c286-070f-47a8-ab5f-caa8b9f33a16 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1363 microversion: 2.1 time: 0.173057 Sep 13 14:40:27.304215 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2054/4020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:27 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:28.327544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:28.328175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:28.334569 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:28.335041 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:28.335469 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:28.336144 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:28.336592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:28.337009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:28.473147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:28.480699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9d3efbca-5d36-4569-978d-dbc4ca0df1b3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1363 microversion: 2.1 time: 0.157633 Sep 13 14:40:28.481262 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1967/4021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:28 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:29.098088 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-77886316-47c1-4573-90ce-0a8e1c9e0b8e req-a1fa0253-56f5-4320-992d-8a2cc6ff3e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b169f1-23a6-45bf-86fd-4891b99420b7", "name": "network-vif-plugged", "status": "completed", "tag": "9f9fc81f-c8de-479d-84eb-6286534f7dbe"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:40:29.103396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:40:29.109695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-77886316-47c1-4573-90ce-0a8e1c9e0b8e req-a1fa0253-56f5-4320-992d-8a2cc6ff3e02 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:29.110231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-77886316-47c1-4573-90ce-0a8e1c9e0b8e req-a1fa0253-56f5-4320-992d-8a2cc6ff3e02 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:29.110664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-77886316-47c1-4573-90ce-0a8e1c9e0b8e req-a1fa0253-56f5-4320-992d-8a2cc6ff3e02 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:29.122254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-77886316-47c1-4573-90ce-0a8e1c9e0b8e req-a1fa0253-56f5-4320-992d-8a2cc6ff3e02 service nova] Creating event network-vif-plugged:9f9fc81f-c8de-479d-84eb-6286534f7dbe for instance 16b169f1-23a6-45bf-86fd-4891b99420b7 on hv-cinder-85743 Sep 13 14:40:29.127239 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-77886316-47c1-4573-90ce-0a8e1c9e0b8e req-a1fa0253-56f5-4320-992d-8a2cc6ff3e02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082778 Sep 13 14:40:29.127825 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2055/4022] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:40:29.504715 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:29.505323 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:29.511755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:29.512226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:29.512652 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:29.513322 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:29.514445 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:29.514916 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:29.639737 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:29.647536 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5a96214a-01a8-4759-9588-04a492bf02eb tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1363 microversion: 2.1 time: 0.146363 Sep 13 14:40:29.648102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1968/4023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:29 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:30.671713 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:30.672397 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:30.678881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:30.679360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:30.679823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:30.680511 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:30.680953 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:30.681376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:30.814165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:30.821679 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9acda590-aa3a-4756-845e-57a310f7c69a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1363 microversion: 2.1 time: 0.155266 Sep 13 14:40:30.822271 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2056/4024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:30 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:31.843906 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:31.844447 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:31.850790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:31.851250 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:31.851676 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:31.852356 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:31.852801 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:31.853219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:31.983305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:40:31.990806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8f8f7a19-721b-44a5-82f6-d999abff4dc3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1549 microversion: 2.1 time: 0.150840 Sep 13 14:40:31.991516 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1969/4025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:40:31 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:40:32.015085 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:40:32.015588 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:40:32.022004 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:32.022733 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:32.023162 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:32.023834 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:32.024280 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:32.024696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:32.100611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-74fbaf70-db6c-47ef-8568-2455d9a39ed8 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090189 Sep 13 14:40:32.101198 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2057/4026] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:40:32 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:40:33.024180 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-0aa62f5b-4eed-4dd5-9a56-0e0005248b3f req-abfcd898-c762-4de3-879f-3c07b19e018c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16b169f1-23a6-45bf-86fd-4891b99420b7", "tag": "9f9fc81f-c8de-479d-84eb-6286534f7dbe"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:40:33.029154 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:40:33.030402 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:40:33.037376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0aa62f5b-4eed-4dd5-9a56-0e0005248b3f req-abfcd898-c762-4de3-879f-3c07b19e018c service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:40:33.037873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0aa62f5b-4eed-4dd5-9a56-0e0005248b3f req-abfcd898-c762-4de3-879f-3c07b19e018c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:40:33.038294 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-0aa62f5b-4eed-4dd5-9a56-0e0005248b3f req-abfcd898-c762-4de3-879f-3c07b19e018c service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:40:33.049416 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-0aa62f5b-4eed-4dd5-9a56-0e0005248b3f req-abfcd898-c762-4de3-879f-3c07b19e018c service nova] Creating event network-changed:9f9fc81f-c8de-479d-84eb-6286534f7dbe for instance 16b169f1-23a6-45bf-86fd-4891b99420b7 on hv-cinder-85743 Sep 13 14:40:33.054482 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-0aa62f5b-4eed-4dd5-9a56-0e0005248b3f req-abfcd898-c762-4de3-879f-3c07b19e018c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034283 Sep 13 14:40:33.055091 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1970/4027] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:41:09.121143 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:41:09.122670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=5 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:41:09.123467 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=61 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:41:09.124568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:41:09.124716 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:41:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7/ips (ip 10.222.0.20) !!! Sep 13 14:41:09.129719 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:41:09.130224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:41:09.138768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:41:09.139242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:41:09.139670 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:41:09.140342 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:41:09.140789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:41:09.141205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:41:09.165019 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-158290e7-b329-4baf-b752-a6898e8eceb3 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7/ips" status: 200 len: 145 microversion: 2.1 time: 0.044743 Sep 13 14:41:09.165607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2058/4028] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:41:09 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:42:09.252205 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:42:09.253037 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=59 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:42:09.258962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:09.259531 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:09.267311 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:09.267787 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:09.268213 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:09.268885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:09.269332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:09.269772 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:09.295338 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:42:09.367941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a021855c-ba89-4f66-b354-54e1ad1d92a4 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 204 len: 0 microversion: 2.1 time: 0.117556 Sep 13 14:42:09.368732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1971/4029] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:42:09 2022] DELETE /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:42:09.378112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:09.378802 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:09.380980 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:42:09.381671 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:42:09.387692 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:09.388166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:09.388594 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:09.389272 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:09.389721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:09.390850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:09.521643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:42:09.529810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-73af02e6-c3a3-4079-9efc-8452ecb7f081 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1673 microversion: 2.1 time: 0.156939 Sep 13 14:42:09.530401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2059/4030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:42:09 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:42:10.553489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:10.554280 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:10.560592 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:10.561061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:10.561486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:10.562197 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:10.562661 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:10.563680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:10.689273 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:42:10.696949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53bce49a-62c7-4cbd-ba8e-c088ddab826d tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1673 microversion: 2.1 time: 0.147673 Sep 13 14:42:10.697509 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1972/4031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:42:10 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:42:11.721291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-e5a3018c-03b0-492d-9d50-945e219149b2 req-73761a5f-f943-463e-b855-1f6543e2c8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16b169f1-23a6-45bf-86fd-4891b99420b7", "name": "network-vif-deleted", "tag": "9f9fc81f-c8de-479d-84eb-6286534f7dbe"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:42:11.724076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:11.724728 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:11.733039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:11.733251 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e5a3018c-03b0-492d-9d50-945e219149b2 req-73761a5f-f943-463e-b855-1f6543e2c8da service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:11.733522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:11.733819 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e5a3018c-03b0-492d-9d50-945e219149b2 req-73761a5f-f943-463e-b855-1f6543e2c8da service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:11.733971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:11.734598 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-e5a3018c-03b0-492d-9d50-945e219149b2 req-73761a5f-f943-463e-b855-1f6543e2c8da service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:11.734722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:11.735143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:11.735556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:11.746755 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-e5a3018c-03b0-492d-9d50-945e219149b2 req-73761a5f-f943-463e-b855-1f6543e2c8da service nova] Creating event network-vif-deleted:9f9fc81f-c8de-479d-84eb-6286534f7dbe for instance 16b169f1-23a6-45bf-86fd-4891b99420b7 on hv-cinder-85743 Sep 13 14:42:11.755682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-e5a3018c-03b0-492d-9d50-945e219149b2 req-73761a5f-f943-463e-b855-1f6543e2c8da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038577 Sep 13 14:42:11.756324 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2060/4032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:42:11.817521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e8dbc75366467f8fc6f0681e722751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd378f8a7b34d8d82f6a145c62862ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:42:11.831501 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-9c9db525-e645-4ce1-8c38-7398564a2b41 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 200 len: 1605 microversion: 2.1 time: 0.112446 Sep 13 14:42:11.834428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1973/4033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:42:11 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 1605 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:42:12.859133 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:12.859833 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:12.865954 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:12.866433 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:12.866860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:12.867543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:12.867992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:12.868412 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:12.883228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] HTTP exception thrown: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Request method failure captured: Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 HTTP/1.1 Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_HJrKxduDL92LJZkZNQHJbu2xjxUQ0pvqcjV-sYEQ-R-Bv1tjies4sGyXktAUeh5AKam2wEUJhHYtKbkDS5Y0vGRekH8hNjSsJVKnozvglAnJzCHq9sVOcdO2E-gbk45CshvXqPCrfLMALV8eKhamRcYrR3y8yEfbFUvlBvv4xFE0 Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 2fd378f8a7b34d8d82f6a145c62862ac Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:42:12.885837 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fd378f8a7b34d8d82f6a145c62862ac"}]}] Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 2fd378f8a7b34d8d82f6a145c62862ac Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeTestJSON-377204022-project Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 17e8dbc75366467f8fc6f0681e722751 Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeTestJSON-377204022-project Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:12.887839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '16b169f1-23a6-45bf-86fd-4891b99420b7'} Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:42:12.888658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:12.890169 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:12.892279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Returning 404 to user: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:42:12.892279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df614119-f6de-4e53-9ab0-709202b27e32 tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 404 len: 111 microversion: 2.1 time: 0.033640 Sep 13 14:42:12.892279 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2061/4034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:42:12 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:42:12.898187 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-0836fd82-c121-4720-9988-da98a78ad29c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '.version_select at 0x7fc9d4428e50>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:12.917431 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-0836fd82-c121-4720-9988-da98a78ad29c tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949402909" status: 202 len: 0 microversion: 2.1 time: 0.023131 Sep 13 14:42:12.918085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1974/4035] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Sep 13 14:42:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949402909 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:42:13.541631 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:13.542159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:13.548942 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:13.549423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:13.549889 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:13.550574 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:13.551057 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:13.551484 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:13.567233 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] HTTP exception thrown: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Request method failure captured: Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 HTTP/1.1 Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_HJrKxduDL92LJZkZNQHJbu2xjxUQ0pvqcjV-sYEQ-R-Bv1tjies4sGyXktAUeh5AKam2wEUJhHYtKbkDS5Y0vGRekH8hNjSsJVKnozvglAnJzCHq9sVOcdO2E-gbk45CshvXqPCrfLMALV8eKhamRcYrR3y8yEfbFUvlBvv4xFE0 Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 2fd378f8a7b34d8d82f6a145c62862ac Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:42:13.568779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fd378f8a7b34d8d82f6a145c62862ac"}]}] Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 2fd378f8a7b34d8d82f6a145c62862ac Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeTestJSON-377204022-project Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 17e8dbc75366467f8fc6f0681e722751 Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeTestJSON-377204022-project Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.570267 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '16b169f1-23a6-45bf-86fd-4891b99420b7'} Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:42:13.571022 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.572112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.573213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Returning 404 to user: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:42:13.573213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4eeb3462-bed2-474a-8aef-7619cd32f85a tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "DELETE /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 404 len: 111 microversion: 2.1 time: 0.032469 Sep 13 14:42:13.573213 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2062/4036] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:42:13 2022] DELETE /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:42:13.578586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:42:13.579189 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] [instance: 16b169f1-23a6-45bf-86fd-4891b99420b7] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:42:13.585671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:13.586183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:13.586618 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:13.587287 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:42:13.587732 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:42:13.588150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:42:13.601554 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] HTTP exception thrown: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Request method failure captured: Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 HTTP/1.1 Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_HJrKxduDL92LJZkZNQHJbu2xjxUQ0pvqcjV-sYEQ-R-Bv1tjies4sGyXktAUeh5AKam2wEUJhHYtKbkDS5Y0vGRekH8hNjSsJVKnozvglAnJzCHq9sVOcdO2E-gbk45CshvXqPCrfLMALV8eKhamRcYrR3y8yEfbFUvlBvv4xFE0 Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 2fd378f8a7b34d8d82f6a145c62862ac Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:42:13.603240 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2fd378f8a7b34d8d82f6a145c62862ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2fd378f8a7b34d8d82f6a145c62862ac"}]}] Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 2fd378f8a7b34d8d82f6a145c62862ac Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeTestJSON-377204022 Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeTestJSON-377204022-project Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 17e8dbc75366467f8fc6f0681e722751 Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeTestJSON-377204022-project Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.604636 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '16b169f1-23a6-45bf-86fd-4891b99420b7'} Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:42:13.605376 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. Sep 13 14:42:13.606885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:42:13.608142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] Returning 404 to user: Instance 16b169f1-23a6-45bf-86fd-4891b99420b7 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:42:13.608142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-229f91bf-c09e-4219-b333-e065e773f2db tempest-AttachVolumeTestJSON-377204022 tempest-AttachVolumeTestJSON-377204022-project] 10.222.0.20 "GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7" status: 404 len: 111 microversion: 2.1 time: 0.029881 Sep 13 14:42:13.608142 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1975/4037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:42:13 2022] GET /compute/v2.1/servers/16b169f1-23a6-45bf-86fd-4891b99420b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 14:43:10.007648 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:10.008281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:10.010369 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=8 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:43:10.011027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=12 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:43:10.012007 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:43:10.012190 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd (ip 10.222.0.20) !!! Sep 13 14:43:10.020552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.020969 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.021418 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.022407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.022860 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.023359 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.039986 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:43:10.041221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:43:10.045349 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:10.046077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:10.054423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:43:10.054597 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.055076 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.055774 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.056686 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.057143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.057572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.087969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:43:10.145047 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f8c0d7e4-076f-4303-8f07-4641a95d1fae tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 204 len: 0 microversion: 2.1 time: 0.140864 Sep 13 14:43:10.146419 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2063/4038] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:43:10 2022] DELETE /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:43:10.155227 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:10.156015 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:10.162820 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.163360 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.163801 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.164546 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.164948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.165366 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.189309 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ad7b0ac5-9e3b-4a29-8a83-5e5837f46541 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "DELETE /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 204 len: 0 microversion: 2.20 time: 0.150254 Sep 13 14:43:10.193285 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1976/4039] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Sep 13 14:43:10 2022] DELETE /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 13 14:43:10.199748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:10.204203 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:10.211504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.211987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.212448 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.213147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:10.213600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:10.214258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:10.306780 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:10.314619 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b7e33e26-7e0d-4497-962e-d730c267f243 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1680 microversion: 2.1 time: 0.163497 Sep 13 14:43:10.315197 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2064/4040] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:10 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:43:10.352594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:10.360717 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:10.362414 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:10.363561 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-da868d9b-bbf2-4caf-b904-561a01b0bb7d tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1724 microversion: 2.20 time: 0.168707 Sep 13 14:43:10.364116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1977/4041] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:43:10 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:43:11.342615 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:11.343835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:11.352291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:11.352874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:11.353321 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:11.354165 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:11.354628 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:11.355055 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:11.391317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:11.392023 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:11.400035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:11.400943 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:11.401480 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:11.402321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:11.402881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:11.403408 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:11.448396 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:11.458250 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-df6993df-cc75-4423-88e2-8b6a478d3ea0 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1613 microversion: 2.1 time: 0.123455 Sep 13 14:43:11.459317 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2065/4042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:11 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:11.483947 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:11.495199 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:11.497317 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:11.498855 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-60c61391-7ec3-43c2-b2b8-225d987ba92b tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1657 microversion: 2.20 time: 0.111406 Sep 13 14:43:11.500063 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1978/4043] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:43:11 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1657 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 14:43:11.534550 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-45f341cd-8bd3-4ce0-a328-3321c41848e5 req-60fe09a5-2a73-4402-b27c-bbbd53959fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417476eb-1a29-4e86-9ddb-37150d8706cd", "name": "network-vif-deleted", "tag": "a4e37735-ff49-47de-b962-ed3099347eb6"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:11.546455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-45f341cd-8bd3-4ce0-a328-3321c41848e5 req-60fe09a5-2a73-4402-b27c-bbbd53959fa1 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:11.547065 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-45f341cd-8bd3-4ce0-a328-3321c41848e5 req-60fe09a5-2a73-4402-b27c-bbbd53959fa1 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:11.548108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-45f341cd-8bd3-4ce0-a328-3321c41848e5 req-60fe09a5-2a73-4402-b27c-bbbd53959fa1 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:11.565663 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-45f341cd-8bd3-4ce0-a328-3321c41848e5 req-60fe09a5-2a73-4402-b27c-bbbd53959fa1 service nova] Creating event network-vif-deleted:a4e37735-ff49-47de-b962-ed3099347eb6 for instance 417476eb-1a29-4e86-9ddb-37150d8706cd on hv-cinder-85743 Sep 13 14:43:11.572070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-45f341cd-8bd3-4ce0-a328-3321c41848e5 req-60fe09a5-2a73-4402-b27c-bbbd53959fa1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041085 Sep 13 14:43:11.573042 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2066/4044] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:43:11.966047 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-79965cc7-4b3d-4c9b-94c4-1e3a5bb500fc req-5ab2b6f0-81f9-46e3-94ed-2d97b13a3f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272293dc-7bef-48b2-bb35-c76bb953d36b", "name": "network-vif-deleted", "tag": "3cc8be41-d0fc-48ec-8245-d169448e7b4f"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:11.976823 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-79965cc7-4b3d-4c9b-94c4-1e3a5bb500fc req-5ab2b6f0-81f9-46e3-94ed-2d97b13a3f9e service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:11.977833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-79965cc7-4b3d-4c9b-94c4-1e3a5bb500fc req-5ab2b6f0-81f9-46e3-94ed-2d97b13a3f9e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:11.978441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-79965cc7-4b3d-4c9b-94c4-1e3a5bb500fc req-5ab2b6f0-81f9-46e3-94ed-2d97b13a3f9e service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:11.990163 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-79965cc7-4b3d-4c9b-94c4-1e3a5bb500fc req-5ab2b6f0-81f9-46e3-94ed-2d97b13a3f9e service nova] Creating event network-vif-deleted:3cc8be41-d0fc-48ec-8245-d169448e7b4f for instance 272293dc-7bef-48b2-bb35-c76bb953d36b on hv-cinder-85743 Sep 13 14:43:11.996072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-79965cc7-4b3d-4c9b-94c4-1e3a5bb500fc req-5ab2b6f0-81f9-46e3-94ed-2d97b13a3f9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279413 Sep 13 14:43:11.997188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1979/4045] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:43:12.484543 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:12.486045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:12.492739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:12.493517 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:12.493979 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:12.494839 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:12.495289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:12.495710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:12.527845 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:12.528743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:12.545545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:12.546362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:12.547009 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:12.547921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:12.548559 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:12.549807 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:12.552436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:12.552932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:12.553466 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:12.553842 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lazy-loading 'fault' on Instance uuid 417476eb-1a29-4e86-9ddb-37150d8706cd {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:43:12.603648 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:12.604391 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:12.605083 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:12.606716 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lazy-loading 'fault' on Instance uuid 272293dc-7bef-48b2-bb35-c76bb953d36b {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:43:12.697390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:12.706283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:12.713755 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92c30fba107b4dfbb7b7b1582cee2ae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e206bc45915744e29dcb918218fa3416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:12.715150 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d0afb22-dfe0-4fe0-bd76-b318cb211a78 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 200 len: 1372 microversion: 2.20 time: 0.192110 Sep 13 14:43:12.717938 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1980/4046] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:43:12 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 14:43:12.779027 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:12.786471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b3ce13c6-b682-4b1d-86e6-0daa42752e44 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 200 len: 1330 microversion: 2.1 time: 0.306651 Sep 13 14:43:12.789789 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2067/4047] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:12 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 1330 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:13.743918 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:13.744522 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] [instance: 272293dc-7bef-48b2-bb35-c76bb953d36b] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:13.750926 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:13.751401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:13.751875 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:13.752635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:13.753082 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:13.753504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:13.766908 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] HTTP exception thrown: Instance 272293dc-7bef-48b2-bb35-c76bb953d36b could not be found. Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Request method failure captured: Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b HTTP/1.1 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_AwxXXP-zGgQx36_KmMRBRclgIrNHxFgYqgjklhYQObkvWpH1djJ9tQVacS8cYN8A40nlUAzsklCqJUQPr6VXNoFavrTioaf1cxCdGxjytJO4J0zvtf7v1Rop3Nzl4qYyU_aLXJLw-ne0KpFo9N5tjMOECRUWkEsp7XuWe6Kwd75w Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: e206bc45915744e29dcb918218fa3416 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-562646914 Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:43:13.768946 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e206bc45915744e29dcb918218fa3416"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e206bc45915744e29dcb918218fa3416"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e206bc45915744e29dcb918218fa3416"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e206bc45915744e29dcb918218fa3416"}]}] Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeShelveTestJSON-562646914 Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: e206bc45915744e29dcb918218fa3416 Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-562646914 Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeShelveTestJSON-562646914-project Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 92c30fba107b4dfbb7b7b1582cee2ae8 Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeShelveTestJSON-562646914-project Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 272293dc-7bef-48b2-bb35-c76bb953d36b could not be found. Sep 13 14:43:13.770539 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '272293dc-7bef-48b2-bb35-c76bb953d36b'} Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 272293dc-7bef-48b2-bb35-c76bb953d36b could not be found. Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:43:13.771334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 272293dc-7bef-48b2-bb35-c76bb953d36b could not be found. Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 272293dc-7bef-48b2-bb35-c76bb953d36b could not be found. Sep 13 14:43:13.772879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.774140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Returning 404 to user: Instance 272293dc-7bef-48b2-bb35-c76bb953d36b could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:43:13.774140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-17895dbd-173e-4e58-891d-82c1c0bf523c tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b" status: 404 len: 111 microversion: 2.20 time: 0.030386 Sep 13 14:43:13.774140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1981/4048] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Sep 13 14:43:13 2022] GET /compute/v2.1/servers/272293dc-7bef-48b2-bb35-c76bb953d36b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 14:43:13.779522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-366984b4-e28d-43d1-8c0a-6ab270344116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] Calling method '.version_select at 0x7fc9d42d4940>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:13.801918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-366984b4-e28d-43d1-8c0a-6ab270344116 tempest-AttachVolumeShelveTestJSON-562646914 tempest-AttachVolumeShelveTestJSON-562646914-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504762495" status: 204 len: 0 microversion: 2.20 time: 0.026273 Sep 13 14:43:13.802471 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2068/4049] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Sep 13 14:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504762495 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 14:43:13.809183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:13.809831 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:13.815825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:13.816452 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:13.816885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:13.817626 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:13.818048 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:13.818528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:13.832185 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd HTTP/1.1 Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:43:13.833743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:43:13.835221 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '417476eb-1a29-4e86-9ddb-37150d8706cd'} Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:43:13.836039 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:43:13.837366 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:43:13.838702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:43:13.838702 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-28bb0472-7b33-4201-b4ac-8734001eccc4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 404 len: 111 microversion: 2.1 time: 0.029841 Sep 13 14:43:13.839006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1982/4050] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:13 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:43:13.844126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ce420920-941a-42f2-b058-528cea601409 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '.version_select at 0x7fc9cfe77a60>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:13.865851 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ce420920-941a-42f2-b058-528cea601409 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272353626" status: 202 len: 0 microversion: 2.1 time: 0.025413 Sep 13 14:43:13.866533 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2069/4051] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 13 14:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272353626 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:43:14.518631 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-4fd736e6-363b-4c59-b4c8-ce339c92090e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: .version_select at 0x7fc9d796e160>, body: {"keypair": {"name": "tempest-keypair-831471268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUoAnrGyib6+7ylSHtlKGDW1j6eHGOZv/1MoP6Qeu0Iy1MjL2rJ2pfjjvf4zlp+MZqOezCstFSUTQWV2U2W34JNJhN3wq3N8QaeJPnN8kF0nIZIjvXNl+Wk+yNtCUZ0aA=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:14.534545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-4fd736e6-363b-4c59-b4c8-ce339c92090e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:43:14.538432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-4fd736e6-363b-4c59-b4c8-ce339c92090e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:43:14.560497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-4fd736e6-363b-4c59-b4c8-ce339c92090e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046388 Sep 13 14:43:14.561085 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1983/4052] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:43:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:43:15.821179 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1207229193", "imageRef": "938be5bc-b75f-49e6-8889-b4a79a515789", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90f85b86-6272-4c59-ab80-1d663e05af5b"}], "security_groups": [{"name": "tempest-securitygroup--1087280018"}], "key_name": "tempest-keypair-831471268", "user_data": "}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:15.925316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] validate_networks() for [('90f85b86-6272-4c59-ab80-1d663e05af5b', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:43:16.327869 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:43:16.328286 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:43:16.328749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:43:16.329145 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:43:16.329576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:43:16.338354 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:16.338828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:16.339252 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:16.339962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:16.340408 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:16.340830 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:16.357096 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:43:16.361028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Getting quotas for user a22a06667e10411e8d8ce92db4536a1a and project 6136ce7badef4cda8912aa34203a2cc0. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:43:16.372960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:43:16.375253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='938be5bc-b75f-49e6-8889-b4a79a515789',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:43:16.422312 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-58a25f0f-5910-45b5-b1f3-8eeedf7e4b52 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.605886 Sep 13 14:43:16.422960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2070/4053] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:43:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:43:16.435411 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8c4ff9e8-9d2a-4865-8af5-34c23a48b34f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:16.436235 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8c4ff9e8-9d2a-4865-8af5-34c23a48b34f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:16.493387 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8c4ff9e8-9d2a-4865-8af5-34c23a48b34f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:16.500253 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8c4ff9e8-9d2a-4865-8af5-34c23a48b34f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1241 microversion: 2.1 time: 0.069466 Sep 13 14:43:16.500765 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1984/4054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:16 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:17.524075 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:17.524682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:17.531049 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:17.531535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:17.531971 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:17.532664 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:17.533154 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:17.533682 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:17.598032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:17.605770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-72d5cdb8-9fc4-4ca7-a996-efba83842b2c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1293 microversion: 2.1 time: 0.086433 Sep 13 14:43:17.606329 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2071/4055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:17 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:18.629390 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:18.630058 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:18.636883 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:18.637443 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:18.637979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:18.638678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:18.639337 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:18.639759 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:18.781508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:18.789643 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-2eb3b338-0b63-4250-a03d-93085e5aace4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1367 microversion: 2.1 time: 0.164606 Sep 13 14:43:18.790399 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1985/4056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:18 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:19.453770 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-aa9fe65a-b9a7-49f4-aa4f-0fefd8c4e4ed req-d7330823-4dd3-4a62-a28a-6cf35c7f7995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e62803-5b50-4d55-b91e-ca4f523fc63e", "tag": "a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:19.464948 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-aa9fe65a-b9a7-49f4-aa4f-0fefd8c4e4ed req-d7330823-4dd3-4a62-a28a-6cf35c7f7995 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:19.465421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-aa9fe65a-b9a7-49f4-aa4f-0fefd8c4e4ed req-d7330823-4dd3-4a62-a28a-6cf35c7f7995 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:19.465888 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-aa9fe65a-b9a7-49f4-aa4f-0fefd8c4e4ed req-d7330823-4dd3-4a62-a28a-6cf35c7f7995 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:19.477672 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-aa9fe65a-b9a7-49f4-aa4f-0fefd8c4e4ed req-d7330823-4dd3-4a62-a28a-6cf35c7f7995 service nova] Creating event network-changed:a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698 for instance 63e62803-5b50-4d55-b91e-ca4f523fc63e on hv-cinder-85743 Sep 13 14:43:19.482622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-aa9fe65a-b9a7-49f4-aa4f-0fefd8c4e4ed req-d7330823-4dd3-4a62-a28a-6cf35c7f7995 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032679 Sep 13 14:43:19.483699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2072/4057] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:43:19.812727 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:19.813362 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:19.820228 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:19.820695 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:19.821122 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:19.821829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:19.822274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:19.822689 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:19.950086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:19.958171 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-3bdc0836-1566-4d8b-976c-2dd72f5bb78c tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1367 microversion: 2.1 time: 0.149298 Sep 13 14:43:19.958733 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1986/4058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:19 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:20.982401 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:20.983104 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:20.990254 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:20.990736 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:20.991167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:20.991881 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:20.992330 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:20.992752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:21.180358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:21.188212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3731a647-d65a-4205-abfe-4f32ef2cd887 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1367 microversion: 2.1 time: 0.210597 Sep 13 14:43:21.188779 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2073/4059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:20 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:22.262375 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:22.262985 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:22.269204 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:22.269682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:22.270141 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:22.270828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:22.271339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:22.271760 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:22.482768 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:22.491014 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-08ef3b1c-4c71-4727-b0f5-7f8c092da196 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1367 microversion: 2.1 time: 0.283890 Sep 13 14:43:22.491581 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1987/4060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:22 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:23.513416 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:23.513995 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:23.520823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:23.521305 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:23.521768 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:23.522724 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:23.523182 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:23.523608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:23.655462 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:23.663644 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-44ffb701-2a3b-41b7-afbf-285e7b9e2547 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1367 microversion: 2.1 time: 0.154246 Sep 13 14:43:23.664205 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2074/4061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:23 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:23.834579 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-f50a8c0e-9cb6-4bbb-ad36-83fe37b770a0 req-08f0a7d5-d0be-45eb-af52-b3d98a3168f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e62803-5b50-4d55-b91e-ca4f523fc63e", "name": "network-vif-plugged", "status": "completed", "tag": "a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:23.844303 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f50a8c0e-9cb6-4bbb-ad36-83fe37b770a0 req-08f0a7d5-d0be-45eb-af52-b3d98a3168f7 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:23.844773 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f50a8c0e-9cb6-4bbb-ad36-83fe37b770a0 req-08f0a7d5-d0be-45eb-af52-b3d98a3168f7 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:23.845198 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-f50a8c0e-9cb6-4bbb-ad36-83fe37b770a0 req-08f0a7d5-d0be-45eb-af52-b3d98a3168f7 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:23.857168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-f50a8c0e-9cb6-4bbb-ad36-83fe37b770a0 req-08f0a7d5-d0be-45eb-af52-b3d98a3168f7 service nova] Creating event network-vif-plugged:a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698 for instance 63e62803-5b50-4d55-b91e-ca4f523fc63e on hv-cinder-85743 Sep 13 14:43:23.862457 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-f50a8c0e-9cb6-4bbb-ad36-83fe37b770a0 req-08f0a7d5-d0be-45eb-af52-b3d98a3168f7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032463 Sep 13 14:43:23.863049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1988/4062] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:43:24.686083 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:24.686687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:24.693689 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:24.694194 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:24.694623 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:24.695297 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:24.695749 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:24.696164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:24.822518 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:24.830185 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-41fd49c1-b880-4f8f-baa7-cbbf37048150 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1367 microversion: 2.1 time: 0.147748 Sep 13 14:43:24.830698 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2075/4063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:24 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:25.858131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:25.858748 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:25.865344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:25.865844 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:25.866305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:25.866981 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:25.867423 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:25.867868 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:25.994097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:43:26.002335 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-53fe4146-86a1-461f-8082-ec60dfa4189f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1557 microversion: 2.1 time: 0.148337 Sep 13 14:43:26.002921 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1989/4064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:43:25 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:43:26.024997 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:43:26.025472 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:43:26.031845 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:26.032326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:26.032793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:26.033810 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:26.034268 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:26.034691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:26.113445 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b9e88753-8591-48d2-bba1-f560e98df2ce tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092545 Sep 13 14:43:26.114078 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2076/4065] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Sep 13 14:43:26 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:43:27.022653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b8e6bbd8-8a25-45e8-aaa6-64504ec3678d req-939a5d24-11d7-4e76-9cdf-4d1bb653e56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e62803-5b50-4d55-b91e-ca4f523fc63e", "tag": "a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:43:27.028258 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=6 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:43:27.035573 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b8e6bbd8-8a25-45e8-aaa6-64504ec3678d req-939a5d24-11d7-4e76-9cdf-4d1bb653e56b service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:43:27.036060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b8e6bbd8-8a25-45e8-aaa6-64504ec3678d req-939a5d24-11d7-4e76-9cdf-4d1bb653e56b service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:43:27.036492 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b8e6bbd8-8a25-45e8-aaa6-64504ec3678d req-939a5d24-11d7-4e76-9cdf-4d1bb653e56b service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:43:27.047680 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b8e6bbd8-8a25-45e8-aaa6-64504ec3678d req-939a5d24-11d7-4e76-9cdf-4d1bb653e56b service nova] Creating event network-changed:a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698 for instance 63e62803-5b50-4d55-b91e-ca4f523fc63e on hv-cinder-85743 Sep 13 14:43:27.053653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b8e6bbd8-8a25-45e8-aaa6-64504ec3678d req-939a5d24-11d7-4e76-9cdf-4d1bb653e56b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036629 Sep 13 14:43:27.054332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1990/4066] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:44:03.180289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:44:03.181084 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:44:03.182375 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:44:03.182996 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:44:03.187383 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:44:03.187898 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:44:03.197226 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:44:03.197721 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:44:03.198175 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:44:03.198873 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:44:03.199316 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:44:03.199735 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:44:03.227911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8dd7138b-4625-4cac-9209-0db216deb49a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e/ips" status: 200 len: 150 microversion: 2.1 time: 0.048394 Sep 13 14:44:03.228486 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2077/4067] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:44:03 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:45:03.301369 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:45:03.302229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:45:03.303461 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:45:03.303660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Tue Sep 13 14:45:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e (ip 10.222.0.20) !!! Sep 13 14:45:03.312422 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:03.313293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:03.324722 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:03.325200 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:03.325633 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:03.326359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:03.326805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:03.327229 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:03.358312 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:45:03.438858 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a42174ab-299f-4412-875e-e577763220e8 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 204 len: 0 microversion: 2.1 time: 0.140532 Sep 13 14:45:03.439550 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1991/4068] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:45:03 2022] DELETE /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:45:03.449611 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:03.450327 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:03.452522 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:45:03.453166 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=4 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:45:03.460790 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:03.461464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:03.461946 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:03.462657 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:03.463114 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:03.463536 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:03.611376 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:45:03.620370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f3573727-1be6-4e39-9168-65e127a8bde4 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1682 microversion: 2.1 time: 0.175193 Sep 13 14:45:03.620962 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2078/4069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:45:03 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:45:04.645077 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:04.645789 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:04.652546 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:04.653015 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:04.653442 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:04.654143 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:04.654591 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:04.655006 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:04.787226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:45:04.794987 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-503bfc7a-540f-41ab-946d-a0d944a7e775 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1682 microversion: 2.1 time: 0.154128 Sep 13 14:45:04.795545 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1992/4070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:45:04 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:45:05.821694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:05.822361 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:05.829046 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:05.829535 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:05.829992 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:05.830700 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:05.831152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:05.831573 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:05.998393 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:45:06.007895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ede94f65-673e-4292-bccc-06ab4d9f296f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 200 len: 1614 microversion: 2.1 time: 0.191004 Sep 13 14:45:06.008699 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2079/4071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:45:05 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 1614 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:45:06.127902 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-b9ee5436-2f89-474f-8606-4feff160f564 req-52be6c87-85af-4142-857c-cdca459f2ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e62803-5b50-4d55-b91e-ca4f523fc63e", "name": "network-vif-deleted", "tag": "a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:45:06.141219 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b9ee5436-2f89-474f-8606-4feff160f564 req-52be6c87-85af-4142-857c-cdca459f2ad2 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:06.141709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b9ee5436-2f89-474f-8606-4feff160f564 req-52be6c87-85af-4142-857c-cdca459f2ad2 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:06.142833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-b9ee5436-2f89-474f-8606-4feff160f564 req-52be6c87-85af-4142-857c-cdca459f2ad2 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:06.156125 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-b9ee5436-2f89-474f-8606-4feff160f564 req-52be6c87-85af-4142-857c-cdca459f2ad2 service nova] Creating event network-vif-deleted:a3bdbcb4-e5d8-4d88-b5ef-4c2ba030f698 for instance 63e62803-5b50-4d55-b91e-ca4f523fc63e on hv-cinder-85743 Sep 13 14:45:06.162256 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-b9ee5436-2f89-474f-8606-4feff160f564 req-52be6c87-85af-4142-857c-cdca459f2ad2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 Sep 13 14:45:06.163504 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1993/4072] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:45:07.032569 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:07.033116 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:07.040117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:07.040601 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:07.041024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:07.041715 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:07.042186 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:07.042605 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:07.056508 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e HTTP/1.1 Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:45:07.058224 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.059526 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '63e62803-5b50-4d55-b91e-ca4f523fc63e'} Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:45:07.060228 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.061407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.062534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:45:07.062534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-8905a187-bc99-4c3b-9e06-9d46274740c6 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 404 len: 111 microversion: 2.1 time: 0.031426 Sep 13 14:45:07.062534 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2080/4073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:45:07 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:45:07.069653 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-7d2cf9c1-0255-4e95-927e-cb153011f8ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '.version_select at 0x7fc9d5973310>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:07.089510 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-7d2cf9c1-0255-4e95-927e-cb153011f8ad tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-831471268" status: 202 len: 0 microversion: 2.1 time: 0.024515 Sep 13 14:45:07.090274 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1994/4074] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Sep 13 14:45:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-831471268 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:45:07.701932 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:07.702436 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:07.708621 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:07.709098 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:07.710255 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:07.710994 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:07.711441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:07.711858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:07.725043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e HTTP/1.1 Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:45:07.726687 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.728129 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '63e62803-5b50-4d55-b91e-ca4f523fc63e'} Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:45:07.729030 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.730468 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.731880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:45:07.731880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-19ba3ba5-979e-44fc-9545-9bd5c04c534e tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 404 len: 111 microversion: 2.1 time: 0.030073 Sep 13 14:45:07.731880 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2081/4075] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:45:07 2022] DELETE /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:45:07.737055 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:45:07.737859 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 63e62803-5b50-4d55-b91e-ca4f523fc63e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:45:07.744955 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:07.745428 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:07.745879 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:07.746553 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:45:07.747005 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:45:07.747470 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:45:07.760818 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e HTTP/1.1 Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:45:07.762440 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.763842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '63e62803-5b50-4d55-b91e-ca4f523fc63e'} Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:45:07.764637 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. Sep 13 14:45:07.766072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:45:07.767244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance 63e62803-5b50-4d55-b91e-ca4f523fc63e could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:45:07.767244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ce99753f-1754-4941-93e3-8b40b0a94287 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e" status: 404 len: 111 microversion: 2.1 time: 0.031112 Sep 13 14:45:07.767244 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1995/4076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:45:07 2022] GET /compute/v2.1/servers/63e62803-5b50-4d55-b91e-ca4f523fc63e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:09.263983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=8 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:09.264943 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=16 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:09.265983 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:47:09.266225 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:47:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 (ip 10.222.0.20) !!! Sep 13 14:47:09.267326 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:47:09.267638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:47:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 (ip 10.222.0.20) !!! Sep 13 14:47:09.268760 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 14:47:09.269750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Tue Sep 13 14:47:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 (ip 10.222.0.20) !!! Sep 13 14:47:09.276192 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:09.277045 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:09.289930 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:09.290828 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:09.292216 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:09.293148 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:09.293939 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:09.294562 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:09.339463 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:47:09.426147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-043d2e75-bae8-4a63-83b1-4574a642a190 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 204 len: 0 microversion: 2.1 time: 0.165754 Sep 13 14:47:09.426727 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2082/4077] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:47:09 2022] DELETE /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:47:09.433672 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:09.434572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:09.440010 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:09.440642 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:09.448101 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:09.448570 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:09.448998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:09.449678 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:09.450149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:09.450562 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:09.612882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:09.621917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-88c1c9be-9010-4a70-9728-9da17c0ef54a tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1507 microversion: 2.1 time: 0.190757 Sep 13 14:47:09.622483 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1996/4078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:09 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 14:47:10.558290 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:10.559034 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:10.575918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.576490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.577024 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.577872 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.578527 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.579207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.595127 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: DELETE /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd HTTP/1.1 Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:47:10.597128 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.598707 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '417476eb-1a29-4e86-9ddb-37150d8706cd'} Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:10.599544 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.600970 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.602208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:10.602208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e39ac0d7-df46-4695-ae14-453a3ed4213a tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 404 len: 111 microversion: 2.1 time: 0.047381 Sep 13 14:47:10.602208 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2083/4079] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:47:10 2022] DELETE /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:10.609364 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:10.610003 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: 417476eb-1a29-4e86-9ddb-37150d8706cd] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:10.617165 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.617912 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.618541 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.619771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.620537 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.620971 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.636340 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd HTTP/1.1 Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:47:10.638231 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.641190 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': '417476eb-1a29-4e86-9ddb-37150d8706cd'} Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:10.642118 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. Sep 13 14:47:10.643477 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.644578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance 417476eb-1a29-4e86-9ddb-37150d8706cd could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:10.644578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-087e0ffc-02f4-465c-8aef-d34fb881f50d tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd" status: 404 len: 111 microversion: 2.1 time: 0.034346 Sep 13 14:47:10.644578 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1997/4080] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:10 2022] GET /compute/v2.1/servers/417476eb-1a29-4e86-9ddb-37150d8706cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:10.651355 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:10.651949 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:10.653277 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:10.654289 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:10.658608 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.659334 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.659969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.660941 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.662112 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.662377 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.662961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.663328 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.663777 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.664504 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.665041 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.665841 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.684882 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 HTTP/1.1 Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:47:10.686899 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.688114 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'fef415f6-4a45-42df-8fbf-07aaec2d0cf6'} Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:10.688969 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.690321 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.693270 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:10.695251 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c203b693-bfcc-4c91-b426-8d4b796c06e9 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 404 len: 111 microversion: 2.1 time: 0.048874 Sep 13 14:47:10.697102 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1998/4081] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:47:10 2022] DELETE /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:10.707976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:10.709086 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: fef415f6-4a45-42df-8fbf-07aaec2d0cf6] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:10.715881 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.716600 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.717191 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.718097 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:10.718739 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:10.719305 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:10.735027 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 HTTP/1.1 Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:47:10.737059 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: > Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.738825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'fef415f6-4a45-42df-8fbf-07aaec2d0cf6'} Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:10.739651 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. Sep 13 14:47:10.740972 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:10.744236 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance fef415f6-4a45-42df-8fbf-07aaec2d0cf6 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:10.746030 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-c5562827-0472-4f05-a153-0794fb229567 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6" status: 404 len: 111 microversion: 2.1 time: 0.044061 Sep 13 14:47:10.746691 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 1999/4082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:10 2022] GET /compute/v2.1/servers/fef415f6-4a45-42df-8fbf-07aaec2d0cf6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:10.855703 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:10.865270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-3da36def-f19d-434f-b5e2-9efa34e21dd3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1507 microversion: 2.1 time: 0.217827 Sep 13 14:47:10.878490 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2084/4083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:10 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:11.095799 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-293b9417-f876-4228-9637-c5ea87591dc5 req-053547b3-11f6-4c5b-9102-f120afc16f6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a135d16e-8e8e-4582-ac03-366876df7369", "name": "network-vif-deleted", "tag": "bc5cdfa1-9e5a-4662-91f9-047e110b433b"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:11.112528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-293b9417-f876-4228-9637-c5ea87591dc5 req-053547b3-11f6-4c5b-9102-f120afc16f6f service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.112966 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-293b9417-f876-4228-9637-c5ea87591dc5 req-053547b3-11f6-4c5b-9102-f120afc16f6f service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.113378 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-293b9417-f876-4228-9637-c5ea87591dc5 req-053547b3-11f6-4c5b-9102-f120afc16f6f service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.127310 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-293b9417-f876-4228-9637-c5ea87591dc5 req-053547b3-11f6-4c5b-9102-f120afc16f6f service nova] Creating event network-vif-deleted:bc5cdfa1-9e5a-4662-91f9-047e110b433b for instance a135d16e-8e8e-4582-ac03-366876df7369 on hv-cinder-85743 Sep 13 14:47:11.130637 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-70c1bb6e-ffc3-43be-ac3f-acb8dab395f5 req-d049f0da-847c-41bc-8de5-ee106b8892ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92521eb-7555-438a-9c2c-463107546a43", "name": "network-vif-deleted", "tag": "e5c55372-27ef-4a81-9b64-fe1b11dc0ef0"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:11.133064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-293b9417-f876-4228-9637-c5ea87591dc5 req-053547b3-11f6-4c5b-9102-f120afc16f6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128687 Sep 13 14:47:11.136914 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2000/4084] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:11.140807 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-70c1bb6e-ffc3-43be-ac3f-acb8dab395f5 req-d049f0da-847c-41bc-8de5-ee106b8892ed service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.141282 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-70c1bb6e-ffc3-43be-ac3f-acb8dab395f5 req-d049f0da-847c-41bc-8de5-ee106b8892ed service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.141754 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-70c1bb6e-ffc3-43be-ac3f-acb8dab395f5 req-d049f0da-847c-41bc-8de5-ee106b8892ed service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.154318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-70c1bb6e-ffc3-43be-ac3f-acb8dab395f5 req-d049f0da-847c-41bc-8de5-ee106b8892ed service nova] Creating event network-vif-deleted:e5c55372-27ef-4a81-9b64-fe1b11dc0ef0 for instance c92521eb-7555-438a-9c2c-463107546a43 on hv-cinder-85743 Sep 13 14:47:11.159257 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-70c1bb6e-ffc3-43be-ac3f-acb8dab395f5 req-d049f0da-847c-41bc-8de5-ee106b8892ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032708 Sep 13 14:47:11.159890 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2085/4085] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:11.890645 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:11.891345 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:11.897750 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.898237 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.898668 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.899352 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.899805 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.900226 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.922510 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:11.923121 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:11.929624 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.930164 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.930848 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.931558 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.932774 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.933455 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.935524 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:11.936587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:11.936699 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:11.937064 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lazy-loading 'fault' on Instance uuid c92521eb-7555-438a-9c2c-463107546a43 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:47:11.965087 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Going to try to terminate instance {{(pid=120642) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:47:11.983145 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:11.990876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ca604f5e-6caa-4ff8-91c4-1997f91df53e tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 200 len: 1311 microversion: 2.1 time: 0.104908 Sep 13 14:47:11.992489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2001/4086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:11 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:12.054613 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-d6072e35-1821-479d-8101-c4a83d5b0edd tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 204 len: 0 microversion: 2.1 time: 0.136679 Sep 13 14:47:12.055399 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2086/4087] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:47:11 2022] DELETE /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 14:47:12.063350 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:12.063957 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:12.071828 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:12.072527 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:12.073049 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:12.073893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:12.074555 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:12.075054 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:12.107060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:12.107556 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:12.107974 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:12.108417 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.objects.instance [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lazy-loading 'fault' on Instance uuid a135d16e-8e8e-4582-ac03-366876df7369 {{(pid=120643) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:47:12.153359 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:12.162806 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-8ff2c7cf-ce20-4cea-b49b-e0b0ea242497 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1338 microversion: 2.1 time: 0.103046 Sep 13 14:47:12.176107 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2002/4088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:12 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1338 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:13.018461 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:13.019425 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: c92521eb-7555-438a-9c2c-463107546a43] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:13.027479 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.028207 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.028835 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.029643 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.030117 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.030539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.046576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] HTTP exception thrown: Instance c92521eb-7555-438a-9c2c-463107546a43 could not be found. Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Request method failure captured: Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 HTTP/1.1 Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_JYRbhyUnmM--PN1SJeA6-9ligOC4uft0fibnjgJeV3l5Q8ijCT4TiXANrP2BJ21v84ERQE4jDZUoW2yq4J4TyTpTw1RbDFKRAN16tFmVbpfmCdCi5YCNdxY69JJ_ol1z3UFVxWTZdqNSecoff0grl2EFbjSISmM7el7Mak29iQog Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 4a11c6709cba4247acc57bd97250f8a0 Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:47:13.048358 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a11c6709cba4247acc57bd97250f8a0"}]}] Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 4a11c6709cba4247acc57bd97250f8a0 Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-ServerRescueNegativeTestJSON-54027097-project Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 961012089bd147ecab4fcdf5ea3ae4c3 Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54027097-project Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance c92521eb-7555-438a-9c2c-463107546a43 could not be found. Sep 13 14:47:13.051808 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': 'c92521eb-7555-438a-9c2c-463107546a43'} Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92521eb-7555-438a-9c2c-463107546a43 could not be found. Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:13.052632 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92521eb-7555-438a-9c2c-463107546a43 could not be found. Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92521eb-7555-438a-9c2c-463107546a43 could not be found. Sep 13 14:47:13.054752 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:13.056184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Returning 404 to user: Instance c92521eb-7555-438a-9c2c-463107546a43 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:13.056184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9c8c1b4e-a735-40a3-a5b2-0d1c45da44d0 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43" status: 404 len: 111 microversion: 2.1 time: 0.036435 Sep 13 14:47:13.056184 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2087/4089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:13 2022] GET /compute/v2.1/servers/c92521eb-7555-438a-9c2c-463107546a43 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:13.059434 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:13.059975 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:13.066467 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.067046 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.067528 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.068215 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.068710 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.069131 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.095513 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Going to try to terminate instance {{(pid=120643) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 14:47:13.172486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-a59d7f16-89e9-419d-a669-8babdc03b6b3 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 204 len: 0 microversion: 2.1 time: 0.117014 Sep 13 14:47:13.173403 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2003/4090] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Sep 13 14:47:13 2022] DELETE /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 14:47:13.177421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-a3cc13c6-b11b-4870-9744-d50d87da8adc req-598f8cdd-70dd-4f21-bdfc-d2898191ee5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dceb84b-c3a9-4933-b104-8c5d4cebc6ed", "name": "network-vif-deleted", "tag": "974f489a-92d3-4fbf-bb59-7a9a63bf7378"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:13.181685 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:13.182842 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:13.187521 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a3cc13c6-b11b-4870-9744-d50d87da8adc req-598f8cdd-70dd-4f21-bdfc-d2898191ee5d service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.188003 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a3cc13c6-b11b-4870-9744-d50d87da8adc req-598f8cdd-70dd-4f21-bdfc-d2898191ee5d service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.188427 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-a3cc13c6-b11b-4870-9744-d50d87da8adc req-598f8cdd-70dd-4f21-bdfc-d2898191ee5d service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.189575 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.190105 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.190544 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.191245 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.191788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.192110 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.199652 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-a3cc13c6-b11b-4870-9744-d50d87da8adc req-598f8cdd-70dd-4f21-bdfc-d2898191ee5d service nova] Creating event network-vif-deleted:974f489a-92d3-4fbf-bb59-7a9a63bf7378 for instance 5dceb84b-c3a9-4933-b104-8c5d4cebc6ed on hv-cinder-85743 Sep 13 14:47:13.204695 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-a3cc13c6-b11b-4870-9744-d50d87da8adc req-598f8cdd-70dd-4f21-bdfc-d2898191ee5d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031847 Sep 13 14:47:13.205273 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2088/4091] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:47:13.210429 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:13.211110 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:13.217505 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.217960 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.218389 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.219079 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.219519 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.219933 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.253407 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:13.254428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:13.254428 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:13.254776 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.objects.instance [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lazy-loading 'fault' on Instance uuid a135d16e-8e8e-4582-ac03-366876df7369 {{(pid=120642) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 14:47:13.305343 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22a06667e10411e8d8ce92db4536a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6136ce7badef4cda8912aa34203a2cc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:13.314936 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a8e561a3-553f-41d3-a6c5-e133a193c511 tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 200 len: 1338 microversion: 2.1 time: 0.108323 Sep 13 14:47:13.315748 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2089/4092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:13 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:13.346140 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:13.365035 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-70e3a2df-9d73-4039-bf42-fe773b45ed97 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1522 microversion: 2.1 time: 0.187472 Sep 13 14:47:13.365895 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2004/4093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:13 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:14.338840 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:14.339443 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] [instance: a135d16e-8e8e-4582-ac03-366876df7369] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:14.345967 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:14.346441 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:14.346866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:14.347542 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:14.347989 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:14.348404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:14.362607 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] HTTP exception thrown: Instance a135d16e-8e8e-4582-ac03-366876df7369 could not be found. Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Request method failure captured: Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 HTTP/1.1 Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_QZOBlhA3akAGSqz6_ZQMLD_sj_0Smh-aVivCDDu7zoHxGYctEXKvyVox8t3jaaCT_4HaJkHON-SyaQ0904zO3WWXkxAeS9viDnr13rfhIFQ5eyU0r1ytAhjvcqwZsjtFI4CRguokQ6S4tdy36Lpq2xf83Xjv13ySm5HFNAbTIyOE Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:47:14.364291 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6136ce7badef4cda8912aa34203a2cc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6136ce7badef4cda8912aa34203a2cc0"}]}] Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 6136ce7badef4cda8912aa34203a2cc0 Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-511866866 Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: a22a06667e10411e8d8ce92db4536a1a Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-AttachVolumeNegativeTest-511866866-project Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance a135d16e-8e8e-4582-ac03-366876df7369 could not be found. Sep 13 14:47:14.366001 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': 'a135d16e-8e8e-4582-ac03-366876df7369'} Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a135d16e-8e8e-4582-ac03-366876df7369 could not be found. Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:14.366702 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a135d16e-8e8e-4582-ac03-366876df7369 could not be found. Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a135d16e-8e8e-4582-ac03-366876df7369 could not be found. Sep 13 14:47:14.367952 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:14.369691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] Returning 404 to user: Instance a135d16e-8e8e-4582-ac03-366876df7369 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:14.369691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9321dd2e-4730-4032-ae5a-4f511d22825f tempest-AttachVolumeNegativeTest-511866866 tempest-AttachVolumeNegativeTest-511866866-project] 10.222.0.20 "GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369" status: 404 len: 111 microversion: 2.1 time: 0.030816 Sep 13 14:47:14.369691 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2090/4094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:14 2022] GET /compute/v2.1/servers/a135d16e-8e8e-4582-ac03-366876df7369 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:14.390033 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:14.391486 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:14.399068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:14.399586 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:14.400188 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:14.401332 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:14.401873 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:14.402272 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:14.489326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '961012089bd147ecab4fcdf5ea3ae4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11c6709cba4247acc57bd97250f8a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:14.511462 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-21999d54-2e46-4202-b08c-42258e0ae44c tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 200 len: 1480 microversion: 2.1 time: 0.126073 Sep 13 14:47:14.512152 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2005/4095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:14 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 1480 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:14.590850 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-639643ce-0758-48d4-ab1e-086975991c5f req-319eb954-65ff-4900-be82-4aaaffe39e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1791b49a-ae8a-4b9d-a575-dc20ba423604", "name": "network-vif-deleted", "tag": "a9685535-ba6f-4ba1-9ad0-05089e69c294"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:14.600370 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-639643ce-0758-48d4-ab1e-086975991c5f req-319eb954-65ff-4900-be82-4aaaffe39e71 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:14.600847 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-639643ce-0758-48d4-ab1e-086975991c5f req-319eb954-65ff-4900-be82-4aaaffe39e71 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:14.601270 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-639643ce-0758-48d4-ab1e-086975991c5f req-319eb954-65ff-4900-be82-4aaaffe39e71 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:14.614929 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-639643ce-0758-48d4-ab1e-086975991c5f req-319eb954-65ff-4900-be82-4aaaffe39e71 service nova] Creating event network-vif-deleted:a9685535-ba6f-4ba1-9ad0-05089e69c294 for instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 on hv-cinder-85743 Sep 13 14:47:14.620245 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-639643ce-0758-48d4-ab1e-086975991c5f req-319eb954-65ff-4900-be82-4aaaffe39e71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033936 Sep 13 14:47:14.621037 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2091/4096] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:15.221072 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [req-dee0ad12-c1fe-4385-8b7e-4dcfc5f69f8c req-528f79ab-e9aa-4411-b1bc-4f01a87d6b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4a1cd1-4081-43bb-ab56-1944c8161e09", "name": "network-vif-deleted", "tag": "57509781-5f22-4a8d-8be3-7346ce200acf"}]} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:15.231615 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-dee0ad12-c1fe-4385-8b7e-4dcfc5f69f8c req-528f79ab-e9aa-4411-b1bc-4f01a87d6b27 service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:15.232178 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-dee0ad12-c1fe-4385-8b7e-4dcfc5f69f8c req-528f79ab-e9aa-4411-b1bc-4f01a87d6b27 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:15.232876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [req-dee0ad12-c1fe-4385-8b7e-4dcfc5f69f8c req-528f79ab-e9aa-4411-b1bc-4f01a87d6b27 service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:15.244810 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.compute.server_external_events [req-dee0ad12-c1fe-4385-8b7e-4dcfc5f69f8c req-528f79ab-e9aa-4411-b1bc-4f01a87d6b27 service nova] Creating event network-vif-deleted:57509781-5f22-4a8d-8be3-7346ce200acf for instance 1a4a1cd1-4081-43bb-ab56-1944c8161e09 on hv-cinder-85743 Sep 13 14:47:15.250070 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [req-dee0ad12-c1fe-4385-8b7e-4dcfc5f69f8c req-528f79ab-e9aa-4411-b1bc-4f01a87d6b27 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 Sep 13 14:47:15.251331 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2006/4097] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:15.537553 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:15.538284 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] [instance: 1791b49a-ae8a-4b9d-a575-dc20ba423604] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:15.545193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:15.545710 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:15.546212 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:15.547017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:15.547618 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:15.548108 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:15.563013 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] HTTP exception thrown: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 could not be found. Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Request method failure captured: Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 HTTP/1.1 Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjII_JYRbhyUnmM--PN1SJeA6-9ligOC4uft0fibnjgJeV3l5Q8ijCT4TiXANrP2BJ21v84ERQE4jDZUoW2yq4J4TyTpTw1RbDFKRAN16tFmVbpfmCdCi5YCNdxY69JJ_ol1z3UFVxWTZdqNSecoff0grl2EFbjSISmM7el7Mak29iQog Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: 4a11c6709cba4247acc57bd97250f8a0 Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:47:15.564694 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4a11c6709cba4247acc57bd97250f8a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4a11c6709cba4247acc57bd97250f8a0"}]}] Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: 4a11c6709cba4247acc57bd97250f8a0 Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-54027097 Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-ServerRescueNegativeTestJSON-54027097-project Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 961012089bd147ecab4fcdf5ea3ae4c3 Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-ServerRescueNegativeTestJSON-54027097-project Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: > Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 could not be found. Sep 13 14:47:15.565998 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': '1791b49a-ae8a-4b9d-a575-dc20ba423604'} Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 could not be found. Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:15.566728 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 could not be found. Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 could not be found. Sep 13 14:47:15.567793 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:15.568798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] Returning 404 to user: Instance 1791b49a-ae8a-4b9d-a575-dc20ba423604 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:15.568798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-9b10c29e-c245-4a73-8b81-15c384d398f6 tempest-ServerRescueNegativeTestJSON-54027097 tempest-ServerRescueNegativeTestJSON-54027097-project] 10.222.0.20 "GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604" status: 404 len: 111 microversion: 2.1 time: 0.033469 Sep 13 14:47:15.568798 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2092/4098] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:15 2022] GET /compute/v2.1/servers/1791b49a-ae8a-4b9d-a575-dc20ba423604 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:21.901406 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ef986561-399a-40a5-9162-7387995ec19b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Action: 'create', calling method: .version_select at 0x7fc9d78c5790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2011099815"}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:22.358838 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ef986561-399a-40a5-9162-7387995ec19b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.839998 Sep 13 14:47:22.359749 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2007/4099] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Sep 13 14:47:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 842 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 14:47:22.374125 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-accb3838-fd33-40f8-a332-25e3205c69cb tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9cfe55ca0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:22.440520 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-accb3838-fd33-40f8-a332-25e3205c69cb tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 200 len: 345 microversion: 2.1 time: 0.070286 Sep 13 14:47:22.441082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2093/4100] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:47:22 2022] GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 345 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:23.457183 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-6ba6325e-a555-45a7-9dfe-af347d8bd8f9 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d42ab0d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:23.561129 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-6ba6325e-a555-45a7-9dfe-af347d8bd8f9 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 200 len: 346 microversion: 2.1 time: 0.109905 Sep 13 14:47:23.561709 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2008/4101] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:47:23 2022] GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:23.575211 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fed9c5f2-09eb-4c00-a84b-63cfdace90c9 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Action: 'create', calling method: .version_select at 0x7fc9d44f4790>, body: {"snapshot": {"volume_id": "c684fc48-60e4-4ba5-b67f-68d4e2bc27b5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1439885413"}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:23.867010 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fed9c5f2-09eb-4c00-a84b-63cfdace90c9 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.295820 Sep 13 14:47:23.867904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2094/4102] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Sep 13 14:47:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:23.879903 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-fb69a9fc-b355-4ac3-acc9-0e99e9e993c4 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d41990d0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:23.914168 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-fb69a9fc-b355-4ac3-acc9-0e99e9e993c4 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 200 len: 287 microversion: 2.1 time: 0.038117 Sep 13 14:47:23.914790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2009/4103] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:23 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:23.927622 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-cae4aba0-3055-4c59-80cd-003ef04ea91f tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9cffaa040>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:23.982704 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-cae4aba0-3055-4c59-80cd-003ef04ea91f tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.060037 Sep 13 14:47:23.983281 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2095/4104] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Sep 13 14:47:23 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:23.997979 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b3226de5-b90b-4c87-9cd1-50b1643de187 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d42abd30>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:24.055742 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b3226de5-b90b-4c87-9cd1-50b1643de187 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 200 len: 287 microversion: 2.1 time: 0.064861 Sep 13 14:47:24.058265 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2010/4105] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:23 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:47:25.071249 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-1ac6c1fb-3eaf-4d57-b4b1-0d7b998778d9 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d44f4790>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:25.127202 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-1ac6c1fb-3eaf-4d57-b4b1-0d7b998778d9 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 200 len: 287 microversion: 2.1 time: 0.060549 Sep 13 14:47:25.128159 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2096/4106] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:25 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:26.138383 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:26.139401 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:26.143521 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-46dece2f-f206-4916-b3de-2c0cf553d215 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d78c5af0>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:26.189936 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-46dece2f-f206-4916-b3de-2c0cf553d215 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 200 len: 287 microversion: 2.1 time: 0.052792 Sep 13 14:47:26.190526 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2011/4107] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:26 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:27.203044 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-fe8c6b5f-e78b-48b6-b4f0-ba763a6eca9e tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9cfe55b80>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:27.211310 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:27.212146 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:27.247150 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-fe8c6b5f-e78b-48b6-b4f0-ba763a6eca9e tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 200 len: 288 microversion: 2.1 time: 0.047899 Sep 13 14:47:27.248180 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2097/4108] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:27 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:27.262885 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d477b03b-07ef-4443-8484-4815c97a9381 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d796e940>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:27.333962 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d477b03b-07ef-4443-8484-4815c97a9381 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 202 len: 0 microversion: 2.1 time: 0.077694 Sep 13 14:47:27.334719 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2012/4109] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Sep 13 14:47:27 2022] DELETE /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:47:27.343568 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-f1234f91-497c-4a6a-b544-5e0c06d70b72 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9cff7e670>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:27.388294 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-f1234f91-497c-4a6a-b544-5e0c06d70b72 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 200 len: 287 microversion: 2.1 time: 0.048803 Sep 13 14:47:27.390028 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2098/4110] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:27 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:28.407743 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4cb8cfa-0ae9-496c-a196-0cf1e78b3592 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d420b700>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:28.473080 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-e4cb8cfa-0ae9-496c-a196-0cf1e78b3592 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] HTTP exception thrown: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4cb8cfa-0ae9-496c-a196-0cf1e78b3592 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Request method failure captured: Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf HTTP/1.1 Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjIJf5F03xsZfUo6KvN-QGWYmzSd5oTmjKSrijqgeajklfBhGcmufQBCH7phyBLmM30E0OZiw3NZk76Yko5yqs5yx8HddCmenqAPO6UFv3YY5EhlZPapilsQqLkQkigU8D2WnJRsTjxWwuNHqS_-5gDvresVR3HHxIpW3hSbgbZE1A-8U Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:47:28.485761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}] Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 2e27ac5355154d5a810d4a1da0416dc5 Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'de77bc33-0a6a-43b0-913f-b2a7e060efdf'} Sep 13 14:47:28.487060 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. (HTTP 404) (Request-ID: req-26961e2d-961f-47e0-9571-1cb8a3a593b0) Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.487829 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:47:28.488843 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 14:47:28.489893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. Sep 13 14:47:28.490956 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:28.495992 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-e4cb8cfa-0ae9-496c-a196-0cf1e78b3592 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Returning 404 to user: Snapshot de77bc33-0a6a-43b0-913f-b2a7e060efdf could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:28.497124 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-e4cb8cfa-0ae9-496c-a196-0cf1e78b3592 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf" status: 404 len: 111 microversion: 2.1 time: 0.098862 Sep 13 14:47:28.497931 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2013/4111] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Sep 13 14:47:28 2022] GET /compute/v2.1/os-snapshots/de77bc33-0a6a-43b0-913f-b2a7e060efdf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:28.507032 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-4618c833-77a6-460e-ba5b-e9ade8d5b05d tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9cfe551f0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:28.616729 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-4618c833-77a6-460e-ba5b-e9ade8d5b05d tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 202 len: 0 microversion: 2.1 time: 0.113549 Sep 13 14:47:28.621477 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2099/4112] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:47:28 2022] DELETE /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 14:47:28.631208 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-dcd001b9-9141-43f3-9e2c-709e4a739275 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d7a1cf70>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:28.733998 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-dcd001b9-9141-43f3-9e2c-709e4a739275 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 200 len: 345 microversion: 2.1 time: 0.108656 Sep 13 14:47:28.735181 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2014/4113] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:47:28 2022] GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:29.748909 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95a88811-dd53-457d-9c3b-ea2199d6b0b1 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9cffb44c0>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:29.886432 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-95a88811-dd53-457d-9c3b-ea2199d6b0b1 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] HTTP exception thrown: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95a88811-dd53-457d-9c3b-ea2199d6b0b1 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Request method failure captured: Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 HTTP/1.1 Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjIJf5F03xsZfUo6KvN-QGWYmzSd5oTmjKSrijqgeajklfBhGcmufQBCH7phyBLmM30E0OZiw3NZk76Yko5yqs5yx8HddCmenqAPO6UFv3YY5EhlZPapilsQqLkQkigU8D2WnJRsTjxWwuNHqS_-5gDvresVR3HHxIpW3hSbgbZE1A-8U Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:47:29.889866 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}] Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 2e27ac5355154d5a810d4a1da0416dc5 Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': 'c684fc48-60e4-4ba5-b67f-68d4e2bc27b5'} Sep 13 14:47:29.891385 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. (HTTP 404) (Request-ID: req-f3e302a2-adc5-48b8-80e6-8e182f7eb064) Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:29.892332 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:47:29.893906 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 14:47:29.895195 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:29.896756 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:29.899126 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-95a88811-dd53-457d-9c3b-ea2199d6b0b1 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Returning 404 to user: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:29.900884 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-95a88811-dd53-457d-9c3b-ea2199d6b0b1 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 404 len: 109 microversion: 2.1 time: 0.155110 Sep 13 14:47:29.901858 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2100/4114] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:47:29 2022] GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:29.915239 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab0ae8ff-aeb8-48a8-9a57-56f25c3a5c18 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d420b160>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:30.028514 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.wsgi [None req-ab0ae8ff-aeb8-48a8-9a57-56f25c3a5c18 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] HTTP exception thrown: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab0ae8ff-aeb8-48a8-9a57-56f25c3a5c18 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Request method failure captured: Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: request: DELETE /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 HTTP/1.1 Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept: application/json Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Accept-Encoding: identity Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Connection: close Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Length: 0 Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Content-Type: application/json Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Host: 10.222.0.20 Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: Openstack-System-Scope: None Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Auth-Token: gAAAAABjIJf5F03xsZfUo6KvN-QGWYmzSd5oTmjKSrijqgeajklfBhGcmufQBCH7phyBLmM30E0OZiw3NZk76Yko5yqs5yx8HddCmenqAPO6UFv3YY5EhlZPapilsQqLkQkigU8D2WnJRsTjxWwuNHqS_-5gDvresVR3HHxIpW3hSbgbZE1A-8U Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Id: None Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Domain-Name: None Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Identity-Status: Confirmed Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Is-Admin-Project: True Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Id: default Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Domain-Name: Default Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Role: member,reader Sep 13 14:47:30.031066 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Roles: member,reader Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}] Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Id: default Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Domain-Name: Default Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Id: 2e27ac5355154d5a810d4a1da0416dc5 Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: method: Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: exception: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: action_args: {'id': 'c684fc48-60e4-4ba5-b67f-68d4e2bc27b5'} Sep 13 14:47:30.032548 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. (HTTP 404) (Request-ID: req-1d6ca5fc-8300-43af-976e-3b26f70a0f11) Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:30.033433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 14:47:30.034674 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 14:47:30.035893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.037976 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.040175 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab0ae8ff-aeb8-48a8-9a57-56f25c3a5c18 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Returning 404 to user: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. {{(pid=120643) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:30.042276 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab0ae8ff-aeb8-48a8-9a57-56f25c3a5c18 tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 404 len: 109 microversion: 2.1 time: 0.130660 Sep 13 14:47:30.043577 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2015/4115] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Sep 13 14:47:29 2022] DELETE /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 14:47:30.055904 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1a3b7fd-5f8e-4502-91cf-e787bf27152b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Calling method '.version_select at 0x7fc9d4da1670>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:30.115237 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.wsgi [None req-e1a3b7fd-5f8e-4502-91cf-e787bf27152b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] HTTP exception thrown: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1a3b7fd-5f8e-4502-91cf-e787bf27152b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Request method failure captured: Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: request: GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 HTTP/1.1 Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept: application/json Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Accept-Encoding: identity Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Connection: close Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Length: 0 Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Content-Type: application/json Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Host: 10.222.0.20 Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: Openstack-System-Scope: None Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: User-Agent: python-urllib3/1.26.12 Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Auth-Token: gAAAAABjIJf5F03xsZfUo6KvN-QGWYmzSd5oTmjKSrijqgeajklfBhGcmufQBCH7phyBLmM30E0OZiw3NZk76Yko5yqs5yx8HddCmenqAPO6UFv3YY5EhlZPapilsQqLkQkigU8D2WnJRsTjxWwuNHqS_-5gDvresVR3HHxIpW3hSbgbZE1A-8U Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Id: None Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Domain-Name: None Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Identity-Status: Confirmed Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Is-Admin-Project: True Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Id: default Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Domain-Name: Default Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Role: member,reader Sep 13 14:47:30.117423 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Roles: member,reader Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/aaee679d12b94bcab792ffdd0f2ec333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/aaee679d12b94bcab792ffdd0f2ec333"}]}] Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Id: aaee679d12b94bcab792ffdd0f2ec333 Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1831809834 Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Id: default Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Domain-Name: Default Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Id: 2e27ac5355154d5a810d4a1da0416dc5 Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1831809834-project Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: method: Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: exception: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: action_args: {'id': 'c684fc48-60e4-4ba5-b67f-68d4e2bc27b5'} Sep 13 14:47:30.119556 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. (HTTP 404) (Request-ID: req-401e395f-32ea-4238-8ecd-cd68b4c55050) Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:30.120378 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 14:47:30.121625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 14:47:30.122905 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: ERROR nova.api.openstack.wsgi Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-e1a3b7fd-5f8e-4502-91cf-e787bf27152b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] Returning 404 to user: Volume c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 could not be found. {{(pid=120642) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 14:47:30.124134 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-e1a3b7fd-5f8e-4502-91cf-e787bf27152b tempest-VolumesSnapshotsTestJSON-1831809834 tempest-VolumesSnapshotsTestJSON-1831809834-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5" status: 404 len: 109 microversion: 2.1 time: 0.068367 Sep 13 14:47:30.125453 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2101/4116] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Sep 13 14:47:30 2022] GET /compute/v2.1/os-volumes/c684fc48-60e4-4ba5-b67f-68d4e2bc27b5 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 14:47:31.497624 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d51f98f4-f04f-4772-bc93-b1dc733b268a tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Action: 'create', calling method: .version_select at 0x7fc9d41801f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1404536340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9qWSNz/smhGhfvE4yqYfqQECSNF1QXIITV1kxJVy+siiJTeWY2XZM6JV6rgGb/y5E4SSvNfd2rcFAeK7ojGVAa36yPwlpmSc9FdngLihf80anpfkskxDTE3GENaDapEg=="}} {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:31.517489 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d51f98f4-f04f-4772-bc93-b1dc733b268a tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Getting quotas for project 4c0eff8e63c74120a5e32169e69f12f9. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:47:31.522671 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.quota [None req-d51f98f4-f04f-4772-bc93-b1dc733b268a tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Getting quotas for user abd9c6e1b3af4692888aaa29d06e918f and project 4c0eff8e63c74120a5e32169e69f12f9. Resources: {'key_pairs'} {{(pid=120643) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:47:31.557628 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d51f98f4-f04f-4772-bc93-b1dc733b268a tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.297088 Sep 13 14:47:31.558283 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2016/4117] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Sep 13 14:47:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:47:55.738167 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1910587430", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1404536340", "security_groups": [{"name": "tempest-secgroup-smoke-1785143036"}], "networks": [{"uuid": "d17a4eaf-9502-4a54-97bd-989fb36cfb2d"}], "block_device_mapping_v2": [{"uuid": "cf184991-e2f9-4873-b64b-abc2a954b255", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:55.869608 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.network.neutron [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] validate_networks() for [('d17a4eaf-9502-4a54-97bd-989fb36cfb2d', None, None, None, None, None)] {{(pid=120642) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 14:47:56.273347 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Flavor limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 14:47:56.274421 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Image limits 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 14:47:56.274931 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Flavor pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 14:47:56.275895 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Image pref 0:0:0 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 14:47:56.276313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.virt.hardware [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120642) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 14:47:56.285870 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:56.286817 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:56.287539 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:56.288355 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:56.288918 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:56.289420 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:56.314253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Getting quotas for project 4c0eff8e63c74120a5e32169e69f12f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 14:47:56.314253 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.quota [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Getting quotas for user abd9c6e1b3af4692888aaa29d06e918f and project 4c0eff8e63c74120a5e32169e69f12f9. Resources: {'cores', 'ram', 'instances'} {{(pid=120642) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 14:47:56.381017 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Going to run 1 instances... {{(pid=120642) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 14:47:56.383152 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf184991-e2f9-4873-b64b-abc2a954b255',volume_size=None,volume_type=None)] {{(pid=120642) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 14:47:56.564739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-61d1755a-3c01-42e6-af20-1501ab842cda tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831164 Sep 13 14:47:56.565576 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2102/4118] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Sep 13 14:47:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 14:47:56.574038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=4 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:56.574788 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:47:56.578757 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-f6d738c7-cf33-4a63-9c6a-3fd2613dd385 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:56.579587 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-f6d738c7-cf33-4a63-9c6a-3fd2613dd385 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:56.666195 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-f6d738c7-cf33-4a63-9c6a-3fd2613dd385 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:56.684013 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-f6d738c7-cf33-4a63-9c6a-3fd2613dd385 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1089 microversion: 2.1 time: 0.110819 Sep 13 14:47:56.687665 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2017/4119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:56 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1089 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:57.712231 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:57.712856 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:57.720095 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:57.720762 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:57.721193 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:57.721911 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:57.722404 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:57.722764 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:57.802365 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:57.802552 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-21c5c185-9a70-431d-8daa-64e93d55351c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1187 microversion: 2.1 time: 0.094456 Sep 13 14:47:57.803353 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2103/4120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:57 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:58.833147 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:47:58.834320 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:47:58.859682 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:58.860151 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:58.882293 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:58.883614 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:58.884249 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:58.886848 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:59.131954 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:47:59.149572 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-b2190f3d-f676-42c1-bf98-3f26bf669126 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1273 microversion: 2.1 time: 0.326484 Sep 13 14:47:59.150825 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2018/4121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:47:58 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1273 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:47:59.584489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-ad1abd4b-4201-43d6-bd11-1c42139b0169 req-5dcb0855-4003-4ff8-ae43-8cfa6dd1b50f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2933e5b8-bde7-4fa8-97d8-14cfa651475e", "tag": "ecba9deb-89d9-4ee4-9c7d-20363bd278c0"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:47:59.611031 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ad1abd4b-4201-43d6-bd11-1c42139b0169 req-5dcb0855-4003-4ff8-ae43-8cfa6dd1b50f service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:47:59.611863 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ad1abd4b-4201-43d6-bd11-1c42139b0169 req-5dcb0855-4003-4ff8-ae43-8cfa6dd1b50f service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:47:59.612630 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-ad1abd4b-4201-43d6-bd11-1c42139b0169 req-5dcb0855-4003-4ff8-ae43-8cfa6dd1b50f service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:47:59.653739 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-ad1abd4b-4201-43d6-bd11-1c42139b0169 req-5dcb0855-4003-4ff8-ae43-8cfa6dd1b50f service nova] Creating event network-changed:ecba9deb-89d9-4ee4-9c7d-20363bd278c0 for instance 2933e5b8-bde7-4fa8-97d8-14cfa651475e on hv-cinder-85743 Sep 13 14:47:59.664348 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-ad1abd4b-4201-43d6-bd11-1c42139b0169 req-5dcb0855-4003-4ff8-ae43-8cfa6dd1b50f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084613 Sep 13 14:47:59.665386 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2104/4122] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 14:48:00.173886 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:00.174594 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:00.180766 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:00.181339 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:00.181797 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:00.182497 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:00.182952 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:00.183373 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:00.340635 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:00.358790 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-d1678f54-2809-4831-818b-4e18b9d0149d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.189420 Sep 13 14:48:00.359410 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2019/4123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:00 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:01.382732 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:01.384464 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:01.403823 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:01.404313 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:01.404758 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:01.405457 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:01.407658 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:01.409220 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:01.576937 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:01.585236 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-ec072c71-82d1-41da-a313-eef4075939c0 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.206887 Sep 13 14:48:01.585923 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2105/4124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:01 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:02.608917 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:02.609525 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:02.615876 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:02.616344 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:02.616767 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:02.617441 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:02.618487 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:02.618933 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:02.751735 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:02.759771 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-5bb601b9-37f8-4858-a2c0-cc05acb470a1 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.154605 Sep 13 14:48:02.760432 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2020/4125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:02 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:03.782054 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:03.782665 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:03.789069 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:03.790292 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:03.790917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:03.791617 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:03.792070 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:03.792491 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:03.926917 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:03.935173 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-a94327f8-4707-4501-9e50-44eb19d8c43c tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.156929 Sep 13 14:48:03.935730 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2106/4126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:03 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:04.958202 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:04.959590 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:04.966246 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:04.967051 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:04.967660 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:04.968610 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:04.969061 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:04.969907 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:05.136116 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:05.144326 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-ab8b3f1b-8e21-4d89-9917-26319732ce17 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.189948 Sep 13 14:48:05.144905 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2021/4127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:04 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:06.167082 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:06.167696 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:06.175112 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:06.175603 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:06.176043 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:06.176750 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:06.177209 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:06.177625 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:06.315469 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=2 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:48:06.322874 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG dbcounter [-] [120642] Writing DB stats nova_cell0:SELECT=6 {{(pid=120642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:48:06.418318 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:06.426892 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-5e4fb31c-a6df-42d9-a465-65cf0c7d231d tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.264442 Sep 13 14:48:06.427681 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2107/4128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:06 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:07.451833 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:07.452593 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:07.456271 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG dbcounter [-] [120643] Writing DB stats nova_cell0:SELECT=2 {{(pid=120643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 14:48:07.463149 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:07.463634 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:07.464068 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:07.464761 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:07.465429 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:07.466038 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:07.618922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:07.627353 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-aa6614cf-baf1-4419-8726-c7bcfc260c7b tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.179602 Sep 13 14:48:07.628092 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2022/4129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:07 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:08.652142 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:08.652879 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.compute.api [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120642) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:08.659803 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:08.660489 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:08.661147 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:08.662021 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:08.662541 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:08.663242 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:08.803064 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.policy [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120642) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:08.811981 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [None req-b15cc079-7640-4bd1-8487-a21ddd2283f9 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.164154 Sep 13 14:48:08.812559 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2108/4130] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:08 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:09.835861 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:09.836832 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:09.843433 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:09.843923 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:09.844347 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:09.845019 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:09.845465 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:09.845913 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:09.982995 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:09.990613 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cb043637-0216-4264-9a34-222eafed7bf2 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.158747 Sep 13 14:48:09.991148 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2023/4131] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:09 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 14:48:10.449717 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG nova.api.openstack.wsgi [req-7d002b51-8378-41f9-8005-165c26263c93 req-2a1556ff-2c96-4a62-afef-5b352d34bcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2933e5b8-bde7-4fa8-97d8-14cfa651475e", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9deb-89d9-4ee4-9c7d-20363bd278c0"}]} {{(pid=120642) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 14:48:10.459616 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7d002b51-8378-41f9-8005-165c26263c93 req-2a1556ff-2c96-4a62-afef-5b352d34bcdf service nova] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:10.460089 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7d002b51-8378-41f9-8005-165c26263c93 req-2a1556ff-2c96-4a62-afef-5b352d34bcdf service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:10.460513 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: DEBUG oslo_concurrency.lockutils [req-7d002b51-8378-41f9-8005-165c26263c93 req-2a1556ff-2c96-4a62-afef-5b352d34bcdf service nova] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120642) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:10.472638 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.compute.server_external_events [req-7d002b51-8378-41f9-8005-165c26263c93 req-2a1556ff-2c96-4a62-afef-5b352d34bcdf service nova] Creating event network-vif-plugged:ecba9deb-89d9-4ee4-9c7d-20363bd278c0 for instance 2933e5b8-bde7-4fa8-97d8-14cfa651475e on hv-cinder-85743 Sep 13 14:48:10.477708 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: INFO nova.api.openstack.requestlog [req-7d002b51-8378-41f9-8005-165c26263c93 req-2a1556ff-2c96-4a62-afef-5b352d34bcdf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208662 Sep 13 14:48:10.478910 dv-cinder-857434-1-iscsi devstack@n-api.service[120642]: [pid: 120642|app: 0|req: 2109/4132] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Sep 13 14:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 14:48:11.014159 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.api.openstack.wsgi [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Calling method '>' {{(pid=120643) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 14:48:11.014778 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.compute.api [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] [instance: 2933e5b8-bde7-4fa8-97d8-14cfa651475e] Fetching instance by UUID {{(pid=120643) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 14:48:11.021893 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:11.022379 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:11.022813 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:11.023508 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Acquiring lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 14:48:11.023961 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 14:48:11.024386 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG oslo_concurrency.lockutils [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Lock "98002c82-0fa6-4467-9ed3-a3065eaa8d97" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120643) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 14:48:11.156158 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: DEBUG nova.policy [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd9c6e1b3af4692888aaa29d06e918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0eff8e63c74120a5e32169e69f12f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120643) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 14:48:11.163922 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: INFO nova.api.openstack.requestlog [None req-cd43c088-5f5a-466c-b6f3-1a3b594178b3 tempest-TestShelveInstance-1535721368 tempest-TestShelveInstance-1535721368-project] 10.222.0.20 "GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e" status: 200 len: 1261 microversion: 2.1 time: 0.154302 Sep 13 14:48:11.164473 dv-cinder-857434-1-iscsi devstack@n-api.service[120643]: [pid: 120643|app: 0|req: 2024/4133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Sep 13 14:48:11 2022] GET /compute/v2.1/servers/2933e5b8-bde7-4fa8-97d8-14cfa651475e => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0)